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This report presents the evaluation design and 
results of a two-year pilot test of the Wisconsin System for 
Instructional Hanaigement (WI'S-SIB) in seven Wisconsin elementary 
schools. WIS-SIH is a management information system designed to 
support management processes ^in Individually Guided Education 
programs. The evaluation design, which is based on perceptual and 
judgmental information from psers as well* as objective data on system 
operation, examine^ the functioning, utilization, and effects of the 
system. Inservice training for computer-terminal aides, teachers, 
principals, and school- level coordinators was found to. be essential 
for elf fective system functioning. System utilization varied greatly 
from school to school, and those schools tkat used WIS-SIB most 
frequently appeared to be most satisfied with it. Evidence on effects 
of the system suggests it reduced the amount of time required for 
clerical tasks. Teachers r.eported that the hours spent on planning 
did not change, but the ef f ectiv^e^ess of time spent on planning 
increased. Student achievement showed an increasing trend, but,, these 
changes capndt be directly attributed *to WIS-SIB implementation. 
WIS-SIB was found to be more cost-effective as .a management tool than 
as a .recordkeeping system. (Author/JG) , - 
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ABSTRACT 



- '-^he Wisconsin System for Instructional Management (WIS-^IM) is 
designed to provide record keeping and management support for programs 
of Individually Guided Education, This paper reports the results of 
a^ two-year pilot test of the'^implement^tion of WIS-SIM in seven 
Wisconsin elementary schools. The evaluation design includes 
consideration of system functioning, utilization and ef f ects , ^ased 
on perceptual and judgemental information supj^lied by users, as well 
as actual data collected on system operation. 

System functioning is concerned with the capabilities of both 
the human and physical components of the information system. 
Inservice sessions were .successful in increasing particpants' knowledge 
about and understanding of WIS-SIM, The essential nature of effective 
4:raining of computer-t>erminal/aides, teachers, principals and school 
level cootdinators on successful implementation i& emphasized. Turn- 
around time was examined as a part of system functioning. While 
WIS-SIM^s capable of very fast turn-around, it is considered that 
thist level responsiveness is not required for most school level 
decision needs. ^ 

'it > 

The utilization of the system varied greatly from school. to school. 

Those school's in which th# system was used most frequently appeared' 

to be most satisfied with it. Most accesses to WIS-SIM were for the 

purpose of computing information; the most frequently Requested 

r.eports were for individual student achievement records and for 

information to assist with ther grouping of students. Users rated 

all reports as being yseful and teachers reported that many of their 

tasks were affecte^d by WIS-SIM. ^ ^ 

The presumed effect that WIS-SIM had in the allocation of teacher 
time to clerical, planning' and instructional activities was examined. 
The evidence suggests a reduction in the Amount of time required on 
clerical taska. Tq^^aoher commentTs expressed that the number of bours 
spent on planning had not changed, but that^'the effectiveness af 
time spent on planning had l^icreased. Student achievement* demonstrated 
an increasing trend, but neither the changes in teacher time on 
activities nor the changes in student achievement can be directly 
attributed to WIS-SIM^implementat ion because of design limitations. 
Teachers in schools where the system, wai used reported very positive 
attitudes toward the system>and its effects. 

The cost of operaiiing JWIS-SIM varies widej.y depending on'system 
usage^ and what costs are included in the estimate, pxdlusive of . 
sbftware development ' and system implementation, operational costs are 

) 

xiii * ^ 
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estimated at approximating $.80 per student per month in each curricular 
area, but not all. .of these costs necessarily represent increases, to < 
the total school budget. It is concluded that th^ cost effectiveness 
of WIS-SIM .resides in its potential as a management tool, not a& a 
record keeping system. 

Recommendations are included in the report concerning site ^ 
selection, staffing and inservice and system implementation. The 
evaluation' framework use^ for this study is'reviewed as a basis' for 
future rersearch and evaluation studies on management information 
systems. The study concludes that the majority^- »of objectives and 
design goals have been attained. The pil6t test of WtS-SIM is important 
as a proof of the concept of instructional, management information 
systems but does not provide strong evidence that this system is cost 
effective in improving educational outcomes. 
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^ I 

EVALUATION DESIGN 

r , ' • * 

This report contain^ the design and evaluation results* of a 
two-year pilot test of the Wisconsin System for InS^tructional >taoage- 
raent (WIS-SIM). WIS-SIM is a management information system designed 
to support management processes in individualized programs of 
education, particularly educational programs being implemented, in 
accordance with the precepts of ' Individually Guided Education (TGE) . 
Individually Gifitied Education is a comprehensive systfem of education 
designed to produce 'higher educational achievements through providing 
for individual* differences between students in areas such as rate 
of learning and learning style. Although the overall concept of IGE 
includes components such as a multiunit organization^ provisions for. 
a. variety of curriculum materials, evaluative procedures, and a program 
for home-school-community relations, it Is the instructional program- 
ming model that is especially important for th§ design of the computer 
management system, WIS-SIM. ^ 

The instructional programming model assumes the^ existence of a 
set of ;neasurable objectives for a curriculum, area. It is designed • 
to take into -account the pupil's beginning level df performance, 
rate of progress, style of learning, motivational level, and ot^her 
characteristics important in the context of the educational program 
of 'tl\e school. The instructional* programming model provides a basis 
for curriculum components developed at the Wisconsin Research and 
Development Center for Cognitive Learning, two of which were supported 
by WIS-SIM during i:he pilot test: Wisconsin Design for Reading Skill 
Development (WDRSD) and Developing Mathematical Processes (DMP),*^ 

Individualized programs are generally quite complex in design 
and even more complex in operatio.n. While the task of creating an 
initial list^of goals or objectives for a particular curriculum area ; 
may be difficult, the* task of keeping t;rack of s'tudents 'as they 
progress through the varidus 'goals or objectives is an even greater 
problem. The teacher's task*is made difficult by the need to assess 
initial performance levels for each curriculum unit, make a diagnosis 
of instructional need, select an appropriate instructional srf^tegy 
to meet the need, and give a criterion-referenced test to ascertain . 
levels of goal' attainment for ,each student. 

*An extensive discussion of Individually Guided E<|u^ation and these two 
curriculum components may be found in Klausmeier, Rbssmiller, & Saily, 
1977. - • " : 
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A comprehensive, manually-operated system of individualized 
instruction may not be feasible. Rather, it seems evident that '^^ 
individualized instructional programs may require support from 
automadea information stomte, processing, and retrieval mecHanisms. 
Areas of an individualized system which are difficult to mahage 
manually itivolye capturti:vg, storing, retrieving, and reporting 
information.^ Lists of objectives for each instructional area need to 
be formulated, fljled, constantly updated, and maintained. They need 
to be. continually revt^vjl^d in terms of both group and individual 
progress. Pupil /performance on assigned objectives must be recorded 
and reviewed. Testing d.§ pupils occurs at both pre- and post- 
instructional stageis and machine scoring of these tests is particularly 
feasible and , desirable / especially' for comprehensive placement tests. 
Perhaps most important/ of all, reports to pupils, teachers, scljtool « 
administrators, and parents, that* can asVist them in the process of 
instructional decisiom making, can be provided accurately and rapidly 
vhen a system of computer managed' instruction is employed. 

» Computer managed instruction (CMI) ^ys^tems seek to facilitate 
the processing of information and supplying this information at 
appropriate times and places so that it can be applied directly to 
instructional^ decision making. The instructional cycl« in programs of 
individualized instruction may be defined-as involving five processes 
and two decision areas. Initially, testing', designed to proyide 
placement information about students, is carried out (Process 1).\ 
These placement tests are then scored and the results compared with 
mastery or performance levels that have:»been specMied for each student 
•and for'^ each instructional objective (Process 2). Diagnosing (Process 
3) produces infoVmation that is utilized in assessing instructional 
need, relative to a^particular curricular program (Decision Area 1). 
Prescribing or guiding (Process 4) is^ designed to provide information 
useful for sheeting those instructional activities (Decision Area 2) 
that are most appropriate for meeting the student's inptnuction'al 
ne^ds. The' selected Activities are carried out< systenjatically during 
instruction '(Process 5) after which testing (Process 3|) again takes 
place to determine if the student has met the instructiional .objectives. 

The basic structure of programs of individualizea instruction, 
as discussed by Spuck, Hunter, Owen, & Belt (1975) , leads to*^ the 
following assumptions concerning instructional^ progr/ams that" may be 
supported by a system of computer management: 



1. There exist instructional missions and gc/als that are 
re'd^icible to sets of measurable instructiional objectives 

2. Testing instruments and procedures that may^be'used to \ 
asse'ss mastery of the instructional- objectives are available 

3. Levels of mastery, or perfoVmap:ce standards, are specified' 
for each child and for each insttuctional objective 



A. Objectives that form a part of each student's instructional 
program are delineated 

5. Dependencies existing between objectives are specified 

6. Norma tive*- information exists, if required, for input into 
the specifying of long-r'ange performance" expectations 

7. Educational activities and materials exist that provide 

- indivi<4ualized instructional experiences. toward the accomplish- 
ment pf the specified instructional ob'jectives 

8. It iff-'pos^ible quantitatively and qualitatively to assess 
the/ibdiviaaal characterisitcs of students essential to 
indq^dualizing instructional activities 

9. It is possible <;iuantitatively and qualitatively to assess 
the resource implications of alternative educational 
experiences. ^ 



EVALUATION PLAN , - , . 

A' .prilji^^ry purpose of the evaluation of a management information 
^system (HIS) is to assess the extent to which the goals and objectives 
of the system are being realized and to identify factors associated 
with successful outcomes. The informatioh collected in an evaluation 
can be used to make decisions about system design, refinement, and 
operation, as well as decisions concerning the continuation or 
expansion or the system. When the evaluation focuses on system develop- 
ment and improvement,^ it is 'called formative; when it is concerned 
primarily with continued or expanded use of the system, it is called 
suiranative. This evalua,tion was designed to be formative. As such, 
the information collected was utilized invmaking decisions about systfem 
design and refinement. The process of' WIS-SIM development is continu- 
ing, and the design of a more generalized instructional management 
system was formulated on' the- basis of the pilot test evaluations 
presented in this report. (See Belt & Spuck, 1975, for a description 
of the general design for this system.) 

Mbre generally than the formative assessment of the goals and 
objectives of WIS-SIM, this eyaluation may be viewed as a proof of the 
concepr of; computer managed ijnstruotion, and seeks the answer to the 
following question: Can-a system of computer managed instrjuction 
designed to support programs' of individualized education such as IGE 
be successfully developed and implemented? ' , . » 

Formative and summative evaluation may vary both in-,^he type of 
information "collected and in the design of the evaluation. In 
summative evaluations, the information collected shduld be directly 
related to the impact the system has on -the ^timate goals^ of the system. 
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In an educaitional envirphment, tffis wouljlKindjLtide'' student learning 
and changes in student behavior. The deigns employed should be as 
rigorous and as experimental as possible, and igtiould take place when- 
*system development has-* stabilized . When the evaluati^ is formative, ^ ^ , 
the information collected relates to both direct and ultimate ^ 
effects of the system, to whether the system is being implemented in 
accordance with de^iTgn specifications, and to whether^ progress -is 
being made toward ach:^ving the outcomes for which th^ system was 
developed, ^he design of the formative evaluation^ will, of necessity., 
,be less experimental and less formal than a summative Qvaluatioh* 
In both formative and summative evaluations, the primary foCus is 
on the, objectives of the program or system td be e>y;feluatecf . In 
-format ive^evaluation-s especially, however, an attempt should be made 
to examine the implementation in a manner that extends beyond the \ 
objectives, in order to identify positive or negative factors associated 
with the implementation that may not be included i^^ the .statement of 
objectives . ^ ^ fv^' ^ 

Management information systems such as WIS-SIM are^'formalt 
configurations of 4iuman and physical resources that support management 
' decision processes within an organization. The main goal of ^WISr-SIM 
is to improve decision making in order' to maximize the educational 
progress for each child while making efficient" use of the available 
human, material^ and fimancial resources. The objectives of WIS-SIM ' 
are: " 

• ■ ■ 1 ■ 

1. To iffentify decisions .that are related to ci\e instructional^ 
- process <♦ 

2. To^ determine what information wQuld be most useful to . / 
decision mak^prs involved with the decision ^ 

3. To arrange mechanisms to capture required data 

4. To summarize the data in a form most usable to the decision, 
'maker • * 

5. * To arrange for the timely delivery of appropriate information 

to the decision maker ^ 

6. To evaluate the utility of the information to the decision 
process.' 

An ej^ensive description of WIS-SIM and its reporting capabilities 

is included in a chapter by Spuck, 1977. • 

A number of design goals- were used as guides in the development 
of WIS-SIM. The following six goals are those that received primary 
emphasis in the development of this system (Belt & Spuck, 1974): 
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1. To £acilitfate tjlSfe- learning environment for each child in 

*' - terms of the instructional and organizational requirements 

' . , of IGE' 

• , \ 2r To provide information that is. useful to educational decision 

- ^ makers at the junit, school, atid district levels 

3. To imfjrove (fommunications with parents and upgrade the 
qualify of reporting to fehem.'aboutf student achievement 

4. To make minimal demands on teachers to^ learn the system 

5. To make minimal demands on teachers to perform tasks that 
are different from normal classroom activities 'and, Where 
possible, to reduce the paper work requirements of *school 
personnel * ' ' 

^ h . 

6. To make computer maragement of' instructio'n available to a 
" large n^imber, of IGE schools. o 

In order to ascertain the extent to which the go^ls and ol^ective 
of WIS-SIM were being met, a formative evaluation framework wa^ 
developed, as presented in Figure I3, Thts framework includes three 
dimensions of formative evaluation and three types of information. 
Formative evaluation is comprised pf the dimensions of functioning^ 
utilization, 'and effects. Evaluation in each of'these dimensions 
seeks to answer the following questions : 

1. Functiotiing — Are thewarious components^ of the manag^m^t 
information system, both human and physical, capable of 
operating in accordance with design expectations? 

2. Utilization — For which management processes is,-^ the system 
* • being employed, and ar^ these processes consistent with. 

those identified in the system design? 

3. Effects — What results are achieved from the utilizatio'n of 
the system, and are the"* oljjectives of the system being met? 

Information available for the assessment of the system is classified 
into three types: 

A. Actual — Objective information derived from a primary source 

\ 

B. Perceptual — User descriptions of system operations and 
effects* <w 

C. Judgemental — User conclusions or attitudes about t-he 
perceived value and benefit of the system. 
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Figure 1. Formative Evaluation Plan for WIS-SIM* 
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Thfe three 'levels in each of the two dimensions presented in Figure 1 
create a nine-celled matrix* The various information collected ih 
the evaluation may be classified within these cells. The -information 
listed in th^se cells will -be discussed in the remaining chapters of 
this, report* and will be organized by the three dimensions of farmative 
evaluation of WIS-SIM: functioning, utilization, and effec^ts. 
Detailed e\Jaluation plans were' written* by, Lawrence (197^) ahd 
Bozeman (1976) and were published ^s Project Technical Memoranda //3 
and //7, respectively* An evaluation of the try-out of WIS-SIM was 
published as Technical Memorandum //5 (Lawrence, 1975b). - 

Prior, to the presentation of the "findings of the evaluation, a 
bri^f historical overview of the project will be gi^fen and a profile 
of ^ach school participating in the pilot test will be presented. 
This\ inf ormation is usefiil in the interpretation of evaluation* 
findings. 1 ' - 

I 

HISTORY OF WIS-SIM DEVELOPMENT ^ 



/ 
/ 

, / 



While research and development activities in computer managed 
instruction] were being conducted at the Wisconsin Research and 
Development Center during the late I960's under the direction of 
Dr. M. Vere iDeVault (DeVault, KriewaW, /Buchanan, & Quillitjg, 1969), ; 
WIS-SIM deyellopment began in the spring 1972,* as a cooperative effort; 
between the Wisconsin Research and Development Center and the Duluth 
Public Schools. Dr. Sidney L. Belt of the Research and Development, / 
Center and Dir. Roger Giroux of the Duluth Public Schools, Minnesota, ' 
met approximately monthly to develop a CMI system to support the 
Wisconsin Desiign for -Reading Skill Development (WDRSD) reading 
program. Upoji the completion of the preliminary CMI system -design, 
computer prpgrammers ii\ Duluth began the coding of software in th^ 
fkll of 1972. Implementation of a preliminary CMI sjstem for WDRSD / 
in Duluth became a reality in 'December 1972, when the program became 
operational loij Duluth's UNIVAC 9400 ^^omputer.^ • - . / 

System jd^sign .work to develop computer management for tjie 
Developing Matjhematical Processes (DMP) program began early in 1972. ^ 
These initial design activities resulted in Working Paper 109 (Belt, 
Marshall, & Romberg) which was publi^ed in November 1972. A graduate 
student was emp Toyed part-time in the spring of 1972 to begin the 
programming^ of this system. 



Prior to the fall ofc 1973, there was no principal^ investiga:tor ' 
for the WIS-SIM project. At that time. Professor Dennis W. Spuck 
of the Department of Educational Administration accepted the position 
of principal ^nvestlgator J the project staff was expanded over the - 
next year to include a half-time coordinator for system development, a 
fall-time coordinator for school relations, and' two full-time . programmers , 
Additionally, several graduate assistants were employed by the project. 
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Project efforts from* fall 1973 to fall 197A were devoted ta the 
development of a conceptual basis WIS-SIM and the coVitinued design 
and development of WiSrSIM for WDRSD and t)MP. A working paper outlining 
the updated WIS-SIM design was published ^ January *197 A (Belt & 
Spuck, 1974) anci work began on the coding of these sy$tems> the 
d'evelopment pf*inservice training materials and procedures, and the 
identification of pilot teet sites. Th^ WIS-SlH/WDRSD. system became 
operational on the Madison Academic Computing Center 's UNIVAC llCfS 
and the WIS-SIM/DMP became operational on the Wisconsin Research and 
Development Center's Harris (Datacraft) computer' Suring the summer of 

1974. A cooperative project with the Wisconsin Research and Develop- 
ment Center and the McFarland ^Cpmmunity Schools_was funded under ESEA 
Title III in June 1974. This supplemental proj eofeH#llowed for th^ 
modification of WIS-SIM to support a science curriculum, Science... A 
Process Approach .(SAP^) . 

/ ' ■ ' 

In fall 1974, a CMI program for the Word Attack composient of the 

WDRSD program was implemented in. two schools in McFarland and two 

schools in Waukesha, Wisconsin. fRis system was operated in batx:h 

mode with a courier service. In January 1975, DMP was also implemented 

in . the McFarland schools as a batch program, 'in- March ' 1975 , DMP 

was implemented as a" completely interactive system' in both Waukesha 

and McFarland. WIS-SIM/WDRSD also continued to be operated in the 

Duluth Public Schools. An. interactive front-end, operating on the' 

Harris computer that supported WIS-SIM/WDRSD on the mflvAe computer,^ 

was added in September 1975. This development permitted the schools 

to carry qut.^ill WIS-SIM activities in an interactive mode. 

Also in the fall of 1975, two schools in the Stevens Point 
School District in Wisconsin, Jacksi^n Elementary and PloVer-^hitihg 
Elementary were added to the network. WI§-SIM, at this time^ was 
being utilized in three school districts in both WDRSD and DMP and 
operating in an interactive mode. In Decmeber 19^5, Henry David 
Thoreau Elementary School in the Milwaukee Public Schools was added 
to t-he network. The SAPA program was implemented in the McFarlanS^ 
schools in January 1976, as an interactive program. 

The 1975-76 pilot test, then, was conducted in six schools in 
three school districts, with an additional school added in December 

1975. The 1976-77 pilot test was reduced to three schools, primarily 
for budgetary reasons (bthei^ reasons are discussed in the last 
chapter), with two schools in McFarland ^nd the one school from 
'Milwaukee, being included./ The preliminary version of^h^.-CMI system 

to support WDRSD, developed cooperatively with the Duluth public 
Schools, Minnesota, continued to be operated in that school district 
during the period of this pilot testy but was not considered to be 
an integral part 6f the test, since the system being implemented, 
there was considerably different from that being implemented at * 
the Wisconsin sites. 
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SCHOOL PROFILES ' . ' 

Dyring 1975-76, seven schools used WIS-SIH to. help manage some . 
parts of their -instructional program. The yarious Evaluative data 
for these years were collected from the Conrad Elvehjep and McFarland- 
Elementary Schpols '(McFarland School District, Wisconsin), Barstow 
anci NotthvieW Elementary Schools (Waukesha School District, Wisconsin), 
.the Plover-Whiting and Jackson Elementary Schools (Stevens Point ^ 
School District, Wisconsin) , ^ and the'' Henry David Thoreau Elementary 
School (MilwajLikee Publip Sqh'^ools, Wisconsfh*) . 

Profiles of each school are .giv^n ^n Table I. 



TABLE WIS-SIM PILOT TEST SCHOOL PROFILES, 1975-76 



^ ' ' Plover- 

•McFarland Elvehjem Barstow Northview Jackson Whiting Thoreau 



•Number of 
Students 

Number of 
Teachers 

* Number of 
Aide^ 

Number of 
Aides Using 
Computer 

Number of. 
Administrators 

.Programs ^ 
Supported by 
WIS-SIM 



379 



12 



WDRSD 

DMP 
SAPA* 



321 • 136 



14^ 



WDRS©-^ 
, DMP 
SAPA* 



WDRSD 
DMP 



453 



14 



WDRSD 
DMP 



540 
21 



. 235 



1 

WDl(SD 



650 
28 
13 • 



WDRSD - WDRSD 



Period of 
Using WlS'-SIM 
through June, 1976 



22 mos. 22 mos. 22 mos. 22 mos. 9 mosT 9 rtos. 7 mos. 



*since January 19/6 



"7 
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Several, different modes of i(|^eration were .used In the various sites ^ " 
participating ;Ln the pilot ^st. The two McFarland u:omraunlty. schools., 
McFarland Elementary and Conrad Elvehjem Elementary, operated as* one 
large,- sch(6ol when using WIS-SIM. These two -schoo^Ls -are located 
next to «ach other,, each with its^own staff. One is a-K-3 school 
and th\other drains grades ,^1, 5,. and* 6. Sfnce McF^ftand had . 
receivecTvQjit^e III grant>to support WIS-SIM in th6ir district, 
they employed-^a. coordinator and an aide with these funds. About 
half^f the coordinator's time and most of the aide's time were 

-devoid to the implementation of WIS->SIM in the ^two schools- 
Information ^requ^sts were made by teachers, processed through the 

^coordinator and "^aide, and the output retuMed to the teachers, 

v.- 

-r Barstow Elementary Scfiool did jiOt have a-computer ter^minai 
/ locaded -in the building; rather , they utilized the terminal located 
in the other Waukesha schootT ^orthview Elementary School. In each 
-school, aq aide was used to coordinate WIS-SIM operational activities. 
Initially,' Jacljson Elementary School did ITot have a terminal located 
in Plover-Whiting Elementary School, This was not a satisfactory ^ 
arrangement because oi the distance between the two schools. In 
January 1976, a terminal also was installed in Jackson Elementary 
School. In these "two schools, ^aides also coordinated WIS-SIM' • 
operational activities. 

Thoreau Elementary School in Milwaukee was implementing WIS-SIM 
/ in Dh^ reading area only,. and the reading coordinator working 'in 
/ the school also assumed responsibility for coordinating WIS-SIM 

operational activities in .this schoof^ A computer terminal aid^ was 
also^ employed. The reaciing coordinator not only coordinated 

activities in Thoreau Elementary School, but also acted as a 
major decision maker '(user bf the system) in that school; in fact, 
few other teachers in Thoreau needed Vo come 'in contact with WIS-glM, 
since information requests'; updated' achievement information, and . 
instruction diagnosis and prescriptiori in reading^ were carried out 
^ by the reading coordinator. ^ , ^ ^ 

S» . • 
s used WIS-SIM during^the l^lb-ll school year. Pro- 
files of these^ schools,,. McFarland (McFarland' Elementary and Conrad 
Elvehjem) and Henry David Thoreau are given ip Table' II, the "'two 
McFarland^ schools are listed togetJ^er o^ this pr<)fil^ since, as., 
noted", use of CMI was carried^ out thrbiieh the WIS~'SIM coordinator 
and, computer ter^min^l aide serving both schools. • 
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TABLE II. WIS-SlM PILOT TEST SCJJQOL PROFILES 1976-77 



McFarland SchotSls * Thoreau 



11 



Number of Students. 

Nuniber of Teachers 

Number 'of Aides 

Number of Aides 
Using Computer 

Number of 
Administrators 

Programs Supported 
by WIS-SIM 

Period of Using 

WIS-SIM through June 1977 



746 
25 
7 



WDRSD, DMP 
SAPA 



32 months 



640 
28 
16 



2 

DMP 
17 mqnths 



The next three chapters of this report include an analysis of 
information pertaining, to the functioning, utilization and effects 
of WIS-SIM during the two-year *pi lot test of the system. The last 
chapter coiftains a summary of the report and recommendations for> 
future WIS-^M development and -im^ementat Jon. 
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II 

SYSTEM FUNCTIONING 



System functioning is concerned with whether or not the various 
elements of the system are capable of operating in accordance with 
design expectations^ System elements are ^mpdsed of both plrysical • 
(computer) devices, including hardware and software, and of hulnans 
using the system. The functioning o^ the human elements of the 
system is assessed in terms of understanding their contributibns to 
the syBtem and evaluating the ability of users to carry out their' 
roles effectively/ Their learning and the assessment of their under- 
standings and abilities constituted the inservice program?. The 
functioning of the physical components of the system was assessed 
in terms of a try-out (te9t) of all input and output routines under 
I simulated conditions and later, through test of the speed with which 
requested infoirmation could be generated and data bases coii^ be 
updated (turn-around time). 

INSERVICE PROGRAMS 1975-76 

This section summarizes the results of WIS-SIM inservices that 
staff members conducted in Wisconsin school districts as 'follows r"^- 

1. McFarland School District — for Conrad Elvehjem and McFarland 
■Elementary Schools staffs held at Conrad Elvehjem' School 
on August 26, 1975. ^ 

r • ' 

2. WaukefeHa School District--for Northview and Barstow 
Elementary School staffs held at Northview School on 

^ ' « August 28, 1975. , 

3. ^ Stevens Point School District — fc^r Plover-Whiting and 
Jackson Elementary Schools staffs held at Plover-Whiting 
School on September 27, 1975. 

4^ Milwaukee School District — for Henry David Thoreau Elementary 
School staff held at Milwaukee on December 9, 1975. 

Expectations for teachets,/ principals, and computer-terminal 
aides were formulated and are outlined below: 

I. All participants will : 

A. .Be able to recognize the functions and limitations of 
WIS-SIM in individualized education.' 

\ 

13 ^' 

9^- ' 28 , 
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B. Develop a positive attitude toward the valuk of -WIS-SIM 
^ in the instructional process* 

II.' Teachers will be able to : ^ . * 

A. Comprehend and apply the information contained in: 

1. Unit 'Performance Profiles. 

2. Individual Performance Profiles. . . * ^ 

3. Instructional Grouping Recommendations. 

4 4*. Prereq^uisite Deficiency Reports. i 

B. Decide which types of reports' are needed for specific, 
instructional decisions. , 

III, Computer aides will be able to/ 

» 

A. Correctly request needed reports. 

B. Cprrectly^ subTnTE-Blnid^nt assessment information. 

Several recommendations of the CMI Inservice Report, March 1975 
(Lawxrence, 1975c), were incorporated into 'the /inservice Plan for 
the fall 1975. In particular, less time was /Bpent on overviews, 
'theories, and models, and more time was si^nt on ijractical applica-. 
tion, such as practi^cing form usafe and procedures. Additionally,, 
the teacher handbook (Computer Applications Project, 1975) was 
redesigned as a year-long users* manual. 

The >lcFarland teachers* inservice involved four CMI staff, 'one 
principal, 31 teacliers, and eight other participants (mostly aides). 
The inservice for Waukesha staff in^:luded four CMI staff, two 
principals, 17 teachers, and four other participants. The Stevens 
Point inservice involved four CMI staff, one principal, 37 teachers, 
and three ather participants. The Milwaukee inservice involved 
two CMI staff,' one principal, 31 teachers, anJ '"f our other 
participants. 

The same design was used for each, of the four inservice sessions. 
Each lasted between three and three-and-a-half ho\irs and conformed to 
the following schedule : ' 
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' TIME ' " ACTIVITY * 

8 > 30-9: 00 r INTRODUCTION \ 

' 1975-76^Plans for WlS-SIft 
Pretest* » 

9:00-10:30 . BASIC INFORMATION AND WIS-SIM 

- SIMULATION , ' 

* Use of Teacher's Guide^ » 
Content and Use of the Reports 
* - ^ Short Discussion on Decision 

Making 
WIS-SIM Simulation 
* ' ' i ' ' 

' 10:30-10:45 , BREAK 

10:45-11:00 . - REQUESTING REPORTS—Large Group 

11:00-12:00 ^ ' WORK PERIOD in Unit Groups 

12:00 , Posttest 

' Evaluation of the Inservice 

Condensed summaries of ^e evaluation results were made avail- 
able to WIS-SIM staff, after tKte Ijfaukesha inservice. These results 
did not indicate a need to make any changfes^-in th,e design and, con- 
sequently," the same format was used-for the Stevens Point and 
Milwaukee inservices. 

Inservice Evaluation Results 

Pretests and posttests were administered to assess improvement 
by participants on objectives iB, IIA,- and IIB. Both tests were 
constructed by CMI staff, and each contained questions pertaining 
to the four reports listed under objective IIA. Identical questions 
were on the pretext and posttest, but with, reference to different • 
curricul-um programs^ (DMP or WDRSD) , ensuring that- ,the tests were 
parallel. ^Each test was comprised of seven major quQstiong, » subdivided 
^nto 20 parts. The tests were* scored by the number of porrect responses 
out of 20 on the basis of one point per item. The pretest and 
posttest data were analyzed for each school separately and for the 
total for all schools by using a one-way analysis of variance 
(ffxe'd effects). The results appear below in Tables III and IV. 
A copy of the instruments used is Included* in Appendix A. 

Jrom Tables III and IV, it can be seen that participants made 
a mean gain of -A;02. points out 'of 20 or, approximately, a 20 percent^ 

* 

' V 30 . ,. 



gain from pretest to .posttest / and that tjie improvement over each 
course separately .and over all courses was highly significant. The . 
mean posttest scpre o& 16.89 out of 20, or 84.45 paxce'nt, -is 
sufficiently high to be taken as an indication that obje.qtives IIA' 
and B were fulfilled. It is re'qonmiend'ed that a criterion 



^ ' TABLE III m 
INSERVICE PRETEST AND POSTTEST hffiANS AND STANDARD DEVIATIONS 



School 
* 




PRETEST ' 


! 

POSTTEST 




N 


Mean 


. SD 


N 


Mean 


SD 


McFarland 


43 


12.93 




3.25 


41 




16.95 


, 3 '.'48 


Waukesha 


24 


13.38 




3.09 


■25 




18760 


1.26 


Stevens Point 

« 


52 


13.87 




3.11 


43 ■ 




16.84 


2.98 


Milwaukee 


36 


11.00 




3.12 ■ 


33 




15.61'' 


3.53 


Total 


155 


"12.87 


3.30 


142 ' 


16.89 


3.18 






TABLE 


IV 










ANALYSIS OF 


VARIANCE OF INSERVICE 


PRETEST AND 


POSTTEST DIFFERENCES 




School 


Mean Square (DF) 
^ Between 




Mean Square(DF) 
Error 




F 


P 


McFarland 


339.34(1) 




11.301(82) 




30.03 


.0005 • 


Waukesha * 


334.29(1) 




5.48(47 




60.99 . 


* * 

.0005 


Stevens Point *' 


207.87(1) 




:9.31(93) • 




22.33 


.0005 


♦Milwaukee 
* 


365.28(1) • 




11.04(67), 




.33.08 


.0005 


Total/ 


12.03.48(1*) . ' 


10.51(295)^ 


114.47 


.0001 . 
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or acceptability o^' 85 percent mastery overall be adopted ' for future 
in ^rvice courses of this nature. 

, An analysis ins^ervice evaluation instrument (Appendix A) was 
conducted on the postte^t responses by selecting every third ar^wer-^ 
sheet, resulting in a sample of 50 out of a population of 142. The 
results of the item analysis. Table V, indicate^ that ques-tion IV^ 
in particular, and questions V2 and VII are areas that should be 
explored by project staff. The relatively poor response tP, question IV 
probably can be accounted for by 'ambiguity in the question. It may 
be that teachers confused "not insufficient*' in the question with 
"insufficient" in the instructions. It is suggested that the 
question be reworded to include "insufficient" rather than "not 
sufficient." Question V2 refers to the symbols used in recording ^ 
students' achievement on topic tests, which were not well known 
by the selected Milwaukee responde*nts (only 5 out of 12 answered 
**question V2 correctly). This highlights their relative lack of 
exposure fco^CMI when hompared to respondents frojn other schools, 
many of whom had practical experience with 'CMI before this inservice 
course. ^ Question VII refe^rs to requesting appropriate forms. It 
is recommended that project staff emphasize the appropriate use of 
the various reports in their Vis^its to schools. This recommendation 
applies particularly in^he case of schoqls with little previous 
exposure to WIS-SIM. ^ ^ * . ' 

V 

^ Twch computer7terminal aides each, from McFarland, Waukesha, 
Stevens. Point , and Milwaukee, rece#.yed instruction in reading and 
interpreting request forms, the^ procedures for requesting. WIS-SIJl 
reports, submitting student achievement information, and logging 
on and off the computer. The two computer aides from McFarland 
^ successfully completed all sections of the checklist of computer 
terminal competencies for computer aides ^see Appendix A) during" th)| 
inservice courses. The two computer aides at Waukesha were unable 
to use terminal during the inservice course because the computer 
was down and therefore received verbal instruCjtion on. the procedures.*' 
N6 subsequent assessmeat of their terminal competencies was made. 
' The two (S^puter aides 'at Stevens Poiat and the two aides at Milwaukee 
^successfully completed all sect'ions of the checklist* • ^ 

Attitudes To\^ard CMI ' . ' ' 

Inservice participants' attitudes toward CMI were' investigated 
in Section VIII of both the .pretests and posttests and analyzed 
separately from Sections I to, VII. The instruments used in assessing 
paijticipant attitudes toward CMI are contained in Appendix A. 
Tables ly and V, which suinmar,ize participants' feelings toward CMI 
as indicated on a five-point rating scale, are given. Matching 
each individual particpant's pre- and post-course attitudes was 
not attempted and it should be noted that, generally, mote participants'* 
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^ TAB].E V 

ITEM ANALYSIS ON A SAMPLE OF 50 POSTTEST RESPONSES 



Quest ioh 


It uorrecc 


A correct 


I 1. 




49 


98.0 


2, 


■ 


/. ^ 

HD 


90 


T T V 




A C 


92 .0 






^ 50 


100.0 


III 1. 




- 

49 


■ 

, 98.0 


2. 






lUO . 0 


3. 




49 


* 98^0 








/ 


IV 




28 


56»0 


V 1. 




48 


96.0 


' 2. 




37< 


74.0 










3. 




47 


94.0 


VI 1. 






90. 0 

>< 


•2. 




HZ 


84.0 








oo . U 


VII 


School 


36 


72.0 




Unit 


38 


' 76^0 . 












Teacher 


• 37 


74.0 


2. 




' 37 


74.0 


• 3. 




' 35 


70.0 


* 

4. 




37 


74.0 
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TABLE 'VI 
ATTITUDES TOWARD CMI 



Question: How are you feeling about CMI? 
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TABLE VII 

J- • . , ' 

ATTITUDES TOWARD USEFULNESS OF GMI . 

\ 

Question: Do you think that CMI will be helpful to yo^ 
ia making instructional decisions? 
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responded pre-cours^ than post-course. Responses to each question 
vere analyzed for pretest and posttest differences using.a ^-test 
(independent samples). The independent samples _t-test was, chosen 
because the identity of -the* respondents w^as unknown. A dependent 
^^feyt-est would have been more appropriate if the respondent's identity 
was kAown from pretest to posttest. This analysis was performed 
for each inservice course separately. 

No Milwaukee participants completed S^^ion VIII Pretest and 
only 17 out of 36 of those .participants completed the Posttest. 
Consequently, pretest knd posttest differences were not*" analyzed, 
although the comments Tnade by the Milwaukee participants are 
considered in the next section. Pretest responses were not collected 
from the Milwaukee participants because of their complete lack of 
^ knowledge of what constituted a system of computer managed instruction. 

It is apparent that theNMcFarland participants* attitudes were 
clearly positiv^, pr-e-course and even more positive, post-course. By 
contrast to these obviously positive comments expressed by the 
McFarland participants, the Waukesha participants' pretest comments 
were generally unfavorable, although these attitudes seemed to ameliorate 
The Stevens Point participants, similar to the McFarland participants, 
were clear;.y favorably disposed to CMI at pretest and even more so 
at postfe^t. For the total group, for both questions, the pretest 
mean was approximately 2.30 and^the posttest mean -was about 1.55, 
representing movement from sojnewhat favorable attitudes at pretext ' 
to very favorable attitudes at posttest. The differences for both 
questions were significantly improved from pretest to posttest. 
, It is recommended that suitable criteria of ^acceptability for future 
inservice courses beta jnean ranking of 2 »on e^ch of questions 1 
and^2, 

/ 

As papt of Section VIII of the instrihnent ,rparticipants were 
' asked ta Summarize their positive arid negative feelings about CML 
in a word, phrase, or sentence. These written responses were^ 
suiranarized separ*ately* for each inservice group. • ^ 

Pre-inservice comments from McFarland inservice participants 
mainly concerned the utility of WIS-SIM for recoifd keeping and grouping 
purposes. Less frequently-mentioned positive comments referred to 
sa'vings of time and usefulness, in individualizing instruction. It 
was clear that the posttest comments referred primarily to' the utility 
of the inservice anS the inservice materials, although this was not 
.the intention of^' th^ test item that referred to "your -positive feelings 
about^CMI." The ^ great majority of respondents Commented very favorably 
on the usefulness of the inservice manual in terms of its presenta- 
tion and its reference value. Other common" comments referred to the 
goo'd organization of the' project and also its improving quallt^. 
The essential difference in the pretest and posttest .comments was 
that respondents seemed "jmorfe optimistic about the future ^utility 
of the project after th^^inservice ; this attitude may have been a 
direct outcome of the inservice itself. * 
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Pre-inservice negative comments included references to insufficient 
teacher knowledge of the s^^stem and no saving of time spent in 
preparing records. Doubts ^bout cost benefits and the presence of 
human errors in supplying information to the computer were |lso 
expressed. , The negative comments vere much less-f requently reported, 
and less strongly 30, than the pre-inservice positive comments. 
Again, the post-inservice comments referred to the inservice 
rather than, specifically, to CMI. S6me comments referred to 
insufficient time in the course to understand all of its content. 

In conclusion, it was evident ft.om the comments about' CMI' 
expressed by the respondents from McFarland that the^r attitudes 
towards CMT were favorable before the inservice and -that the inservice 
strengtheaed the'Se attitudes."^ 

By contrast to the obviously positiVfe comments expressed by the 
McFarland teachers both pre- and post-inservice course, the Waukesha 
respondents- comments were generally unfavorable on the pre-inservice , 
questions, although these attitudes s,eemed to temper in the post- 
course responses. The only positive comment expressed several times 
was the opinion th^t the computer-supplied information is helpful 
during' parent-teacher conferences. The^negative comments most often 
dealt with duplication of record keeping, unreliability of the 
computer services, and the timfe consumed in forming the groups. 
These negative comments were not as frequently reported after the 
inservice, but the negative comments still Continued, on the quantity 
of record^kefeping involved. The difficulties encpSntered in the 
'implementation of the J)MP program in the classroom Were commented 
upon several times. 

« » 

The positive comments, as in the case of the McFarland, inservice, 
often referred Vp the quality of the inservice .course itself. Again, ^ 
the inservice manual^ was favorably considered. The CMI project was 
seen to be well organized by a quarter of the respondents and about 
the same number saw CMI as assisting to individualize instruction. 
Based ori the frequency of 'the comments expressed , •it seems that the 
Waukesha respondents are still negatively oriented toward CMI, alfehough 
not nearly to the same degree as before the inservice. ^\ 

^. 0r\iy' slightly more than half of the Stevens Point participants^ 
nfede pre-cour^e comments, which probably reflects their inexperience 
witli CMI. However ^ approximatel:^ 80 percent of the respondents made 
j)ost-cour3e ^comments. By far, the most frequently made po,sitive 
comment offered pre-course concerned the expectation fhat CMI would 
result in^less time spent on record keeping and, especially; on , 
r^'cord keeping applied to grouping. The only other positive comment f 
made more ithan once was that CMI promised to be a complete record ^ 
keeping system. The negative comments expressed pre-course were more 
widely ^stributed and, in the main, referred to extra paper work that 
might be involved*, extra costs involved, ^d the necessity for 
adequate inservice. 
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The- post-course responses were .similar to those made pre- 
course except that more responses were made post-course. Again, 
most participants identified the potential saving of time, especially . 
dn grouping students, as the greatest advantage of CMI. Post-course 
negative comments emphasized the extra' work involved for the aides, 
requiring them' to spend less time on some oth^er duties. Four 
participants referred to the possibility of providing alternative 
groupings based on other student characteristics, thus, making for 
more flexibility in grouping. * . • " 

The Milwaukee par.ticipants^made no pre-course comments and less 
than half made post-course' comments. ^ Theseiwere mainly one word 
comments. Areas of potential concern most frequently reported were 
extra costs and the loss o5 identity of students. Areas" of expected 
improvement most-f sequent ly mentioned were time saved in grouping 
students and better groups (groupings) of students. Generally, the ♦ 
Milwaukee participants* post-test comments, although sparsely and 
concisely made, reflected the tremd in the comments of participants , . 
in other schools. 



Evaluation of Inservice ^ , ^ 

.> Participants ^i-fi the inservice were asked to assess the inservice 
in te^iys of its usefulness, their interest , ^and areas of^mphasis. 
A copy\x)f the insepvic^ evaluation instruntent is included in Appendix 
A. Question 1 referred to teachers* assessments of the usefulness 
and their interest in each of the four sections of the inseryice : 
basic^ information, simulation, requesting reports, and work "period. 
It is clear from teachers* ratings that only a very small number of 
^participants considered any of the sections ks **slightly useful*' 'or * 
"not.at all- useful** ^p/lieV 5/104, 4/135, 12/172 for the four respective 
sections). A justifiable conclusion, therefore, is that the great 
majority of participants^ considered each section of* the inservice 
to be useful. A lesser number of participants considered the inservice 
very interesting although, again,, the great^majority of participants 
considered each of tlYe sections as' being either very interesting or 
fairly interesting. Although the work period, during which 
teachers began *the task of grouping t;heir own students in preparation 
for insi^ruction in the fall semester^ was rated as being both useful 
and interesting, it was^ ranted the least useful and the least interest- / 
ing'of the four sections of the inservice; differences in participants* 
ratings between sections ""were small.** • 

Question 2 asked teachers^ to indicate whether or not the emphasis 
given to eaCh of the objectives of the^inservice was satisfactory. 
Slightly less than 20 percent of the part icj[.p ants considered each 
of the objectives lA and IB to require more emphasis ,^ the other 
participants indicated ^:hat the emphasis was 'satisfactory . Wheit 



24. 



referring to objectives listed under SiBjCtion II, approximately 30 
percent of the respondents reconunended that more emphasis be given 
to comprehending both the Instructional Grouping Recommendation 
Report and the Prerequisite Deficiency Reports, and, also, to 
-^correctly submitting student - assessment information* 

The great majority of teachers rated the level of difficulty of 
-^he material as being fairly or slightly difficult; only one respondent 
considered the material very difficult, whereas about 25 percent 
considered it to be not at all difficult. 

Only 16 out of 138 participants were not at all favorably 
disposed toward taking the pretest and posttests and about 67 
percent indicated that they were fairly favorably or very favorably 
disposed 'toward taking the tests. 

From the summary of participants' responses, it is clear that 
the inseryice was' considered ulfeful and interesting, that the 
emphasis given to all course objectives was appropriate .(although 
it .<vseems warranted to place greater emphasis on objectives IIA 
aqd IID) thatf the level of difficulty was appropriate, and that the 
administration of pretests and posttests was ^not viewed unfavorably 
by most participants. 



Summary of 1975-76 Inservice Results 

The information on which these conclusions^ are based consists of 
participants' responses on pretests and posttests of content covered 
during the inservice course, competency tests administered to 
computer aides, assessments of participants' attitudes toward CMI, 
and participants' evaluation of the inservice course/ 

1. The analysis of the pretest and posttest results indicate 
that very significant improvement was effected by the' 
inservice course and that participants achieved a high 
order of comprehension of the material covered in the 

.(bourse. The .responses to .Question VI, (requesting of - 
.appropriate reports,) indicate that follow-up assistance in 
this area may be beneficial to teachers. 

2. The incomplete instruction of computer aides at the 
inservice course may require follow-up assistance. 

3. The attitudes of participants towards CMI both pre- and po^t- 
course was, overall, strongly positive. The relatively 
neutral attitudes of the Waukesha respondents cause some ^ 
concern, and project staff coul^ direct more attention 
towards improving this situation. ' ■ 

^. Participants viewed* all aspects of the inservice very 

favorably. Perhaps more emphasis should be givea to the ^ 
Grouping Recommendations and Prerequisite Deficiency Reports. 



Evaluation of Inservices 1976-77 



This section summarizes the results of CMI inservices conducted 
by CMI sl:aff members as follows :^ 

1. . Mc Far land School District — for Conrad Elvehjem and 

McFarland Elementary School staffs held at Conrad Elvehjem 
School on August 23, 1976. 

2. Milwaukee School_.District — for Henry David Thoreau Elementary 
School staff held at the school on September 23^ 1976. 

Because McFarland was beginning its third* consecutive year 
of WIS-SIM usage and Henry David Thoreau was beginning its second 
consecutive year, an intensive inservice *training program was not 
considered ruecessary. Rather, a brief review of WIS-SIM was given 
the staffs at bo^th schools. Questions regarding system usage and 
modifications to the system were discussed. 

A questionnaire was administered to the inservice participants 
at the conclusion of the session. The results of this survey are 
presented for the two schools in Tables VIII and IX. Jhe, question- 
naire is included in Appendix A. The attitudes of the faculty and 
staff at the McFarland schools toward CMI, as reflected by the 
ratings on the two sur\^ey questions, are clearly positive. Only 
three of the 24 respondents rated the first question with a rank of 
three. No one ranked the second question below two, where responses 
of one and two are favorable. 

Only four unit leaders were involved in the inservice at Henry 
David Thoreau School. Therefore, the attitude survey is not 
conclusive. Th(pse participating, however, did indicate a favorab|.e 
disposition toward-dMI system usage. ^ 

^ As part of the review inservice evaluation, participants were 
asked to comment about CMI in a word, phrase, or sentence. Comments 
were specifically requested regarding general feelings about CMI, 
problems anticipated, adequacy of the review inservice, and 
suggestions for Suture inservices. 

The McFarland respondents* feelings about CMI were quite favorabl 
Responses indicated that they considered the system very helpful in 
the management of the instructional program. Several teach&rs also 
reported that they^considered the system to be better than when 
initially implemented. The only comments that were not totally 
positive concerned ^pprehensiveness about changes incorporated into . 
WIS-SIM, e.g^, report formats. 'No respondent anticipated any 
problems> using WIS-SIM during the coming school year. The one^-hour 
review insetVice was considered by all the participants to be 
sufficient to refresh their knowledge of the system. With respect 
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^ " - . TABLE VIII 

t 

ATTITUDES TOWARD 6mi 
Question: How are your feelings about CMI? 




School 



McFarland 



Milwaukee 



Favorable 



Choice Distribution Unfavorable 



12 



3 \ 



0 



24 



4* 



Mean 



1.75 



2.0 



SD 



.67 



.816 



*Due to the way in which WIS-SIM was implemented in Milwaukee, only four unit leaders and -the reading 
specialist participated in the Milwaukee inservice . One questionnaire was not returned. 

' V ^ ' ... 

. TABLE. IX [ 
HELPFULNESS OF CMI 

Question: Do you think that CMI ^will be helpful to you in^aking instructional decisions.? 





Favorable Choice Distribution Tinfflvnrflhi e' 


N 


• 

. Mean 


SD 


1 ' 


2 


, 3 


4 


5 


McFarland 
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.509 . 
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1 


2 
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1 


0 


0 


4* 


• 2.0 


^ .816 



*See Note in Table VI 
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to future inservices, it was suggested that they, also, be concise. 
Additionally, a mid-year review inservice was recommended. ' ^ 

The four participants in the Thoreau inservice did not indicate 
negatij^ve feelings regarding CMI, but did reflect less familiarity 
with the system than McFarland. This 'was anticipated, as Th6reau 
teachers have little "^direct contact with ^IS-SIM. Rather, grauping 
and other aspects of the reading program are managed by the reading 
specialist. They did indicate that they wer6, looking forward 
to using the system and did not anticipate any problems during 
the coming school year. 



Summary of 1976-77 Inservice Results 

It appears that a concise, rather than lengthy, review inservice 
is viWed favorably. Based on the respondents' coiranentTs, it seems 
best t3) plan two inservices for each user school, one for returning 
facultiy members already well acquainted with the system and a second 
for nfew staff members unfamiliar with WIS-SIM. The initial inservice 
for a 'school just starting on WIS-SIM would need to be of the more $ 
comprehensive type used in .the 1975-76 pilot tests. The suggestion 
regarding a mid-year inservice appears appropriate also. This 
would provide an opportunity for users to become ihforme^i about 
changes or anticipated' changes as well as to provide fjeedback to the' 
CMI staff regarding problems, modifications, or system improvements. 

TESTING COMPUTER SOFTWARE ' 

, A critical prerequisite to the smooth implementation of a 
computer system is tlie careful testing -o^ that system tcyxetisure. that 
it operates in accordance with the design specif ication^ for the 
system. Individual software components were tested as coding was 
completed*. ' Additionally, the system was tested as a'whole bV project 
staff members. Any discrepancies' between the design specif icat?lons . 
and system operation were noted a^nd changes were made to the system. 
Project staff members using the system were also asked to offer 
suggestions for system improvement. The^ suggestions were reviewed* 
'and those meriting inclusion were implemented in the ne^t system 
update. » \ ^ 

Prior to the two-year pilot test reported, here, WIS-SIM was 
implemented in two Wisconsin school districts to. try out the system.' 
During the year in, which the system was first' implemented in the 
Waukesha and McFarland schools, considerable staff time was spent 
at; the schools, in close contact with thei users of the system. When 
problems were noted, they were resolved as quickly as possible. 
Suggestions fbr improvement were carefully noted and, periodically, 
priorities amongthe suggestions were established, taking account of 
the potential b^efit of their implementation against the'^ cost of 
implementing thfm. The system was in a state of developmental. 
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transition during the entire period Jf the tryout. In addition to , 
the tryout in the Wisconsin schools, the progress of the cooperative 
effort with Duluth Public Schools, Minnesota, was carefully monitored. 
An ^valuation report of -the tryout year was published by -the ♦project 
in 1975 (Lawrence, 1975b). * 



turntARound time . ' ' . 

While the system may be capable of generating the reports and 
.carrying out other operations for which it was designed^ the 'system 
* is of little value to users if it -cannot carry* out these operations ' 
within their time requirements . ; Preliminary assessments of the time 
constraints surrounding system functioning indicated the majority 
of requests could be processed overnight or within a few hours, but 
some needs were more urgent than that, and required faster turn-around. 
It was difficult to get teachejrs to assess realistically the turn- 
around requirements needed and to separate what they desired, or 
might need, from what they actually did need. Since it was dete'tmined 
that there were nee'ds that necessitated fast turn-around, an iiite/- 
' active system was designed and implemented for DMP, and a front-end 
that could submit batch jobs in priority modes was implemented in 
WDRSDI Both systems were designed to be able to' produce requested 
reports and accept data base updates within one-half hour of the 
initial, request. - ^ ^ ' * • • 

4 * » 

Limited information was collected on. turil-around time during 
, tihe 1975-76 school year. Data wei^collected, however, from the two 

McFarland s.chools from May '24*, 1976 to June 15, 1976. ^¥oT the ' 
.purposes of tliis data collectiqiT, turn-around time was defined 
as the difference iri the time of the request and the time^f'the 
receipt of the report at the terminal. Table X shows the mean times 
for each report and program, WDRSD -and DMP/SAPA. It. should be noted, 
that', in WDRSD, the user can request a turn-around time of less 
, than an hour, about an hour, overnight, or over the weekend. DMP 
and SAPA were examined together because both of these* programs are 
processed at the R&D Center, whereas the WDRSD program is processed 
at MACC. This latter processing can be expected to be slower than 
the, former because having been processed at MACC, the data requested 
is sent back to the R&D Center. The user then has to call in 
again to the R&D Center .to confirm if the report is available. 

Turn-around time m^y be misleading because of the levels of ^ 
computing priority the user may s.elect. ^ Under the MACC UNIVAC 1110 
system, the user may choose .five levels of priority which correspond 
ta rel^tiv^e processing time requirements, although this- may vary. 
For example, when little use is being made of the 1110, all priorities 
'may provide approximately the same turn-around time. The four levels 
are: express (less than an hour), normal (about sCn hour), deferred 
(overnight), and convenience (over the weekend). As the mode of ' 
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TABLE X 



TURN- AROUND TIME AT MCFARLAND 
May ^4 - June 1^, 1976 



J 



Report 


. DMP/SAPA 


WDRSD* 


UPP ; 


N = 14 

Mean Time =16.6 
SD = 20.6 


N = 14 

Mean Time =. 73.5 
SD = 43.4 


.IPP 


N' = 16 . 

Mean Time = 25.9- 

SET = 23.4 - 


. .N«^ 40 

Mean Time = 67.2 ' 
SD = 42.4 


IGR 


N = 2 

Mean Time = 12. 5 
SD = 3.5 


•' " " N = 2 • • 

Mean Time = 82.0 
SD = 18.4 

X 


■ .All 
Reports 


N = 32' 

Mean Time =21.0 
SD = 21.7 


• . N = 38 

Mean Time = 69.3 
SD = 41.7 


TABLE XI ' 

TURiN'-AROL^D TII-IE AT MCFARLA^JD - ' 
, ' , . April 11 - April 29, 1977 

^ ^ / ' ' 


Report 


> . » 

DMP/SAPA ' 


^ ' , WDRSp* 


UPP 


N = 8 

'Mean. Time = 28,4 
SD = 22.5 


N '= 11 

Mean Time ^13.0 
SD = 18.2 


IPP 


— ^ '— 

N = -30 ^ • 
Mean Time.= 15.9" 
SD = 13.5 " 


N = 14.^ 

Mean Time = 11. 7 
SD = 9.0 


• .IGK 


; N 9 

Mean Time =17.9 
SD = 7.7 • 


N = 11 

Mean Time = 17.2' 
j SD = 12.1 

I — — 


All 
Reports 


N = 47 ' ' 

Mean Time' =18.4 

SD = 14.98 


N = 36 

Mean Time =13.8 
SD = 13.14 
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* 'Deferred and convenience runs excluded. 
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demand increases, so does the associated cost of computfng. 
Therefore, users are encouraged to use the lower priority modes as 
much as possible. 

/ V / 

, During the school year 1976-1977 , a log was maintained by the 
McFarland CMI project director and the computer terminal aide on 
turn-around time for the entire year. For the purposes of data 
collection during this year, turn-around time was again defined as the 
time actually required for processing (time tKe request was entered 
on terminal to the time of receipt on terminal). ^This was considered 
to be mpre useful information, *as a teacher request for a report 
might conceivably be held before processing due to work loads, 
personnel availability, or other factors. Data' were sampled using 
the three-week period o¥ April 11, 1977 to April 29, 1977. Table 
XI shows the number of respective reports, average turn-around times, 
and standard deviations of each type of -report and pj|ogram. 

More individual performance profiles (IPP's) were requested 
-each year than either unit pe^ormance profiles (UPP's) or instruc- 
tional grouping requests (ICR's);- a larger percentage of ICR's were * 
^ requested during the second sampling period than the- first. 

For DMP/SAPA, turn^around time averaged approximately 21 minutes/ 
during the sample period in 1976 and 18 minutes in 1977.- This 
turnjraround time is well within the requirements specified and is 
noted to be improving with a drop of approximately 3 minutes from 
1976 to 1977. 

The turn^around time for WDRSD was ^about 69 minutes in 1976. 
The user can influence the turn-around time for WDRSD in two ways. 
First, the user can enter a desireff turn-around time, as was noted, 
and second, the user must enter a separate request for the return 
of the report. In other words, the requested report may have 'been* 
processed quickJLy but not returned for several hours, when it was 
needed. The mean turn-around time improved in 1977, to a mean of 
13.8 minutes. It is. anticipated' that the majority of the' change 
froip 69 to 14 minutes was a result of user-controlled factors, 
rather than improvements in system functioning, although^ the 1976 
sample was taken at a time of year when demand on the MACC computer 
may have been heavy. In any event.,' turn-around time -for both WDRSD 
and DMP/SAPA is judged as being within acceptable limits. 
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SYSTEM UTILIZATION 



System utilization is concerned with the management processes 
for wltich the system is being employed and, specifically, i^;Lth 
whether or not the actual uses of the system are consistent ^with the 
designed uses. Included in this chapter is a consideration of the 
number and t3rpe of system accesses, the usage and usefulness of 
reports presented and an assessment of the school tasks affected by 
WIS-SIM operation. * » \ 



Number of System Accesses 

The number of system accesses by the users was estimated by 
tabulation of system logs during selected periods of the 1975-76 
school year and the 1976-77 school year. This irifotmation was • 
recorded 'Separately for ^ach of the JWDRSD,<' DMP , and , SAP A, programs. 
The collection periods for the two years are^.as follows: ^ 



1975-76 



WDRSD 



DMP 

12/r/75 - 12/15/75 A/14/76 - 4/28/76 

5/17/76 - 6/1/76 5/17/76 - 6/1/76 

1976-77 



WDRSD 
3/l/»/77 - 3/18/77 
3/21/77 - 3/25/77 
3/28/77 - 4/1/77 
4/4/77 •- 4/8/77 



DMP 
— » 

9/20/76 - 9/24/76 
1/10/77 -1/14/77 
1/24/77 - 1/28/77 
2/28/77 -•3/4/77- 



In addition to j the tabulations ot accesses, a computer record 
was maintained beginning February 'l, 1977, that contained McFarland's 
system accesses of the WDRSD program. This included the total . 
number of WDRSD runs_ as well as tabulations' and percentages of the . 
WDRSD reports generated. 



31 



49 



32 



Analysis^ of 1975-76 Accesses . \ 

Table -WJ;, which includes the system accesses in 1975-76 made by 
each school using WDRSD, shows these accedes in terms of requests 
for Individual Performance Profiles (IPP's), Grading (update of 
^tudent records). Instructional Grouping Jle commendations ,(IGR's), . 
Score Submission Form (SSF's), and Unit Performance Profiles (UPP's). 
There is a general increase in the .number of accesses from Decemlrer 
to May in all schools, except those in Waukesha.- Grading is -the most 
frequent u^e of the system, with IPPj s ai4d UPP's being the most^ 
frequently requested reports. . *^ 

Table XIII shows^ the number of system accesses mad^ by e.ach 
school using DMP in 1975-7 6 and shows these accesses in terms of 
requests for IPP's, Gra4ing (updating of student records), IGR's,. 
Prerequisite Deficiency Reports (PDR^'s), UPP's, and Implement Instruc- 
tional Grodps (IIG's). As ^with WDRSD, grading is the most frequent 
use of the system\ followed by requests for IPP's. WaukeshI recorded 
no machine , use during the j)eriods sampled,, no IGR's were ^requested , ' 
c ^nd only one IIG access w4fi recorded. 

For the reading program, 56 percent of all ^-equests were for 
grading, 19 percent for IPP's, 14 percent for UPP's, 10 percent for 
JGR's, and onlyJ^percent for^SF's."" 4pproximately the same pattern 
exists for Dfff , with 68 percent of the accesses for grading, 17 
* percent 'f^r IPP's ,^8 percent' for IGR's^ 6 percent for UPP's', i 
percent^or IIG'^s,^and no requests for P^'s. 

'^^r 'both WDRSD and DMP, the McFarland School-s are, by far, the 
most ^'^lis^vjent? users of 'the system (7^.0 accesses per Week), with/the 
4(jgaukesha S.^^hools being the^ least If rg^uent'^users (5.0 accesses per ' 
week)^ Tjiese same observations apply for "both time periods sampled. 
The average nOipber of adce;sses per weejf for ,each school is ^hown below 





ft » 
ft ^ 






. Both ^ 


School 




WDRSD * 


DMP 


Programs 


Mc Far land 






32.5 


74.0 


Jackson 




12'5.-"^.' ' 




' 12.5 


Plover-Whiting 






3.5 


. '3.5 ' 


Waukesha 




5.0 ' 

C 


0.0 


. ' 5.0 


Thoreau , 




9.5' ; , • 




• 9.5 


All Schools 




68.5^ 


^"36.0 


164.5 



TABLE XII 



FREQUENCIES OF SYSTEM' ACCESSES "70?.?^ 



vr 



Schools 



Reports 



IPP 



Gracing 



IGR 



SSF' 



UPP 



Totals. 



^cFarland 



Jackson 



Waukesha 



Dec 
May 
• Total 



18 
23 
41 



32 
56 
88 



Dec 
May 
Total 



Dec 
May 
Total 



.0 
2 



■0 

9 
0 



4 

36 
40 



11 
5 

16 



12 



17 ^ 



0 
0 
0 



3 
4 

7' ' 



1 
0 
1 



1 
0 
1 



3 
17, 
20 



1 
0 
1 



2 

* 0 
2 



58 
108 
166 



■8 
42 
50 

15. 
5 

t 

20 



Thoreau 



Dec 
May 
Total 



0 
9 
9 



0 
10 
10 



Totals 



Dec 
May 
Total 



18 
^- 34 ' 
52 (19)* 



^7 



2 
0 

2 



154 (56) 



11 
16 
27 (10) 



1 
0 

■ 1 



f 0- 
2 .(1) 



5 
11 

' 16 



8 
30 
38 



11 

28 
39 (14) 



89 
185 
27A 



^gj^l^ 5x «* *^"^ ~ percentages 



TABLE XIII 
FREQUENCIES OF ^YSTEM ACCESSES DMP 



Schools 


^t-^ 

.R.eports 


ipp ■ 


Grading^ 


IGR 


PDR 


UPP 


IIG 


Totals 




May 


7 


" 25 


2 


0 


5 


1 (2) 


• 40 


McFarland 


April ' 


16 


61 


9 


0 


4 


0 


90 




Total- 


23 


' 86 


11 


0 


9 


1 


130 




May - 


0 


5 


0 


0 


0 


0 


5 


Plover-^ Whiting 


April ' 


2 


- ■ 7 


0 


0 


0 


0 


9 




Total 


2 . 


12 


0 


0 ~ 


0 


0 


j 14. 


\ 

WauJo^sha 


May 
April 


{ 0 : 

' 0- 


0 
0 


0 


vO 

0 


0 

0' 

1 


« 

0 • 
0 


r 

0 

0 ■ 


V 


^ Total , 


0 






0 


0 ■ 


0 


•o 




May 


7 




2 


0 


. 5 


1 


45 


Totals 


April • 






9 


0 


h . 


0 


99 


* 

> - 


Total - 


25 (17)* 


98. *8) 


11- (8), 


' ' '0 (0) 


9 (6)f 


1 (1) 

1 


144 



5 o, 
ERIC 



*(n) = percentages 



The average number of accessea per week for WDRSD was 17.1 and 
the average number of accesses per week for DMP was 12.0/ Some of 
the schools were likely under-utilizing the system and McFarland was 
placing heavy demand on it; therefore, the average number of accesses 
for a typical user would he expected to fall between McFarland 's usage 
and the mean usage of the other pilot test schools. 

Analysis of 1976-77 Accesses' ^ ( ' ^ ^ 

^ 

Tables similar to those prepared for the l975-76/pilot test x^ar 
were also prepared for the 1976-77 data. Only the McFarland schools 
utilized WIS-SIM/DMP and SAPA during .1976-7.7 . Tables XIV and XV 
show, the number of accesses in these schools, dvef four one-week periods 
A total of 262 aJUg^sses' were reported in DMP and 76 in SAPA. As 
was the case in 1975-76, "^most of the accesses were for grading 
purposes. IPP and IGR re'ports were requested more frequently than 
others, 

■ ' Shown in Tables* XVI and X^III.,aTe the accesses for 'WDRSD in 
the McFarland Schools and the Thoreau School for 1976-77. Grading 
.continues to be the most frequent use of the system- for Thoreau,' 
bui: IPP requests form a larger percentage of the total accesses 
in McFarland. IGR^ requests form abouf J5 percent of the total 
accesses for WDRSD in each schaol. McFarland's usage continues to 
be nearly fou-r times that of Thoreau in the reading area alone. 

, Automated sjstem-monitoring of accesses was initiated in WDRSD 
in February 1977.' Table XVIII contains the number and percentage of 
accesses in. the McFarland Schools from-^e date ,of implementation of 

•monitoring to the end of the school year. AccordiYig to this assess- 
ment, 62 percent of the 1044 accesses were for grading purposes, 2l.3 
percent for IPP's, 9.3 percent for UPP's ^nd 5.8 percent for' IGR's. 
Score ^submission forms (SSF's), used in conjunction with grading, 
accounted .for l.B'.percent of the accesses, and the ^ills eligibility 
profile (SEP), a newly implemented form, accounted for only .3 percent, 
of the accesses. \Since the data reported in this table are compre- 
hensive for a ^four-and-a-half month period, they probably provide the 

'best estimate of the number and distribution^oT accesses by function. 
. . ' - ' ' 

• For all the time periods sampled, McEarland is clearly the more 
frequent user oJE WIS-SIM.as in 1975-76. The average weekly accesses 
by McFarland ^a rid Thoreau are given below. Bas^d on the four week 
samples in 1975-76 and 1976-77, McFarland and thoreau show a definite 
increase in system usage. , - * 



J TABLE XIV 

ACCESSES OF WDP.SD IN THE MCFARLAND ' SCHOOLS 1976777* 



3/1A/77-3/18/77 ^121111-^125111 ^I2%lll-l,lllll hlhlll-hlUll' TOTAL 



FUNCTION 


FREQUENCY 






FREQUENCY 


% 


JREQUENCY 


% 




FREQUENCY 


% 




FREQUENcf 




IPP 


A3 


45.7 




1 / • 


3.8 


47 


51.6 




29 


43.9 




120 


43 


GRD 
w 


' 30 


31.9 




15 


57.7 


18 


19.8 




23 


34.8 






31 


IGR 


4 


4.3 • 




10 




38.5 


22 


24.2 




5 


7.6 




41 


15 


r 

UPP 


17 


18.1 ' 




0 


0 . 


4 


4.4 




9 


13.6 




• 30 


11 


' SSF V 


0 


0 




0 


0_ 


0 


0 




0 


0 




0 


0 


SEP*^ 


6 

* 


0, 




0 


0 


•' '. 0 


0 




d 

* 


0 • 




0 


. 0 


TOTAL 


94 






26 




91 


f 




66 






-277 





*Skill Eligibility Profile • 



9/20/76-9/24/76 



TABLE XV . ^ 

ACCESSES CF DMP'iN'TKE MCFARLAIID SCHOOLS 1$^77 

1/10/77-1/14/77 1/24/77-1/28/77, ' 2/i8/.77-3/4/ 77 



TOTAL- 



FUNCTION 


FREQUENCY 


% 




FREQUENCY, 


•% 


FREQUENCE 


* 


FREQUENCY 






■ FREQUENCY 


% 


UPP 


1 


1.5 - 




2- • 


3.3 


1 


2.1 


13 


14.6 




17 


X 

6 


I?P 


13 


19.7 




' 18 


30.0 


9 


19.1 


32 


36.0 

/' 




72 


28 


ICR 


11 


16.7 




■ ^5 


8.3' 


0 


0 


10 


11.2/ 




,26 


10 


IIG 


5 


7.6 




7 


11.7 


3 


6.4 


4 


4/5 






7 


PDR 


2 ' 


3.0 




1 


0 


0 


0 


0 


0 




.2 


1 


GRD* 


32 

» 


48.5 




28 


46.7 


32 ■ 


68.1 


28 


31.5 




120 


46 • 


DEL SCR** 


2 


3.0 




_ 0 ■ 


0 


■ 2 


4.3 


2 


2.2 




,' 6 ^ 


2 


TOTAL 


66 






60 




47 




^ 89 






262 





*Grading, 
**DELSCR-Spellout 



53 



ERIC 
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TABLE XVI. 

ACCESSES OF SAPA IM THE MCT^ARLA>TD ' SCHOOLS 1976-77 



00 



9iiQne-3i2i,n(y 9iiQin-iiuni iiihni-iiiQni iimiii-iikiii 



TOTAL' 



FUNCTION 
< 


FREQUENCY- 


% 




FREQUENCY 


% ■ 




FREQUENCY 


% 


FREQUE^ICY 


% 


FREQUENCY 


la 


UPP 


" 0 


0- 




' 1 


6.7 




0 


0 


0 


0 


1 


. 1 


IFF 


2 


11.1 




4 


.26.7 




0 


. 0 


. 4 


25.0 


10 


13 


IGR 

yh- 


0 


0 




0 


0 




'1 


6;'5 


3 


18.8 


5 


7 


IIG , 


0' 


0 




0 


0 




1 


3.2 


2 


12.5 


3 


4 


PDR ■ 


0. 


0 




0 


0 




— \ 

1 


3.2 


• 0 


0 


V 


1 


♦ 


8 


44.4 




; "^10 


66.7 




J 

27 


87.1 


/- 

7 


43.8 


/ 

52 • 


68 


DELSCR * 


4 


11. 1 






0 






, 0 


0 


0 


4 


5 


TOTAL 


14 • 






15 






31 




16 




76 





*Spell out DELSCR 



CO 



■fil 



ERIC 



TABLE XVII . 
TOTAL WDRSD ''ACCESSES IN THE MCFARLAND SCHOOLS 1976-77 



39 



2/2/77-6/15/77 




y 



s FUNCTION 


FREQUENCY 


■% 


IPP 


222 


,21.3- 


GRD 


' 647 


62.0" 


ICR 


61 


-5.8 


UPP 


97 


■ 9.3 


SSF ' 


• 14 


1.3' 


SEP 


3 


0.3' 


TOTAL 


1044 





ERIC • 



'2 



TABLE XVIII 

ACCESSES OF vJDRSD IM THE HEN?.Y DAVID THOREAU ^SCHOOL 1976-77 



o 





3/14/77- 


3/18/77 . 


3/21/77- 


ZI25I11 








TOTAL 




FUNCTION 


FREQUENCY 


% 




FREQUENCY 


% 




FHEQUENCY 


% 




FREQUENCY 


%• 




FREQUENCY 
> y 


% 


JPP 


0 


0 




0 « 


0 ' 




4 


36.4 




' 2 


5.4 




6 


1 

8 


GRD 


1 ^ 


50.0 




• 18 


75.0 




4 


36.4 




24 


.64.9 




47 


63 


ICR 


0 


U 




2 


8.3 




0 


•0 




8 


21.6 ' 




ig,J^ 


14 


UPP 


0 


0 




2 


c 
8..3 




0 , 


0 • 




3 


8.1 . 




5 


.7 


' SSF 


• 0 


0 




2 . 


8.3 




1 


9.1' 




P ■ 


0 




3 


4- 


SEP 


1 ■ 


50.0 




■ /" 

0 


0 




2 


18.2 

t 




0 


. 0 




3 


4 


TrfTAL 


2 






. 24 






11 


1 




37 






74 





/ : • , 



ERIC 
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TABLE XIX 



AVENGE NUMBER OF ACCESSES/WEEK 



McFarland 
Thoreau 



WDRSD 

r 

1975-76 .* 1976-77 



41.5 
9.5 



69.25 
18.5 



% Increase 
67.3 
94.7 



McFarland * 



32.5 



65.5 



101.5 



USAGE OF REPORTS 



In May 1976 and April 1977, unit leaders, teachers, and aides • 
in each of the user schools were §urveyed to determine what uses 
were being made of WIS-SIM reports. The emphasis in this evaluation 
*was on the uses of reports otHer than their stated purposes. It 
was assumed that the reports'were used for the purpose for which they 
were designed; therefore, purposes reported by the respondents were 
in additioh to these purposes. The evaluation of the usefulness 
off the report for the purpose for which they were designed is not 
addressed in this section but, rather, is addressed separately in 
^ later section. 

The questionnaires administered in this survey are presented 
in Appendix B. It should be noted they are not identical in ^ 
appearance, as the 1977 instrument consolidated both the usage and 
usefulness evaluations. Items C and*D of the questionnaire relate 
to report usage. 

,In the 1976 questionnaire, five reports were listed together 
with their stated purpose. The reports were: 

• 1. Unit Performance Profile ^UPP). 

2. Individual Perf ormance^Prof ile (IPP). 

3. Instructional Grouping Recommendation-Summary (IGR-S) . 
4» Instructional Grouping Recommendation-Omissions (IGR-0). 

t5. Prerequisite Deficiency Report (PDR) . 
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Respondents ^were asked to describe briefly any uses they had made of 
reports, other than their stated purposes. Respondents were also 
asked to describe any other use^ they had found> for any WIS-SIM 
reports, other than the five specifically referenced. It was 
considered that^the five reports above were those likely to be usecL 

^' .The 1977 questionnaire was similar in format and design except 
for the inclusion of two additipnal reports and samples of these 
reports. The two additional reports, were : 

1. ' Skill Eligibility Profile (SEP). ^ * * 

2. Instructional Grouping Recommendation-Group (IGR-G) . 

/ Jhe number of respondents to the 1976 and 1977 surveys are 
^ shown in Table XX. 



TABLE XX 

NUMBER OF RESPONDENTS USAGE OF REPORTS QUESTIONNAIRE 



« 






< 

19 76 








Unit Lead^s 


Teachers 


Aides 




4. McFarland 


4 


6 


2 




Jackson 


1 


2 


■ 1 




Plover-Whiting ^ 


1 


4 


0 




Bars tow 


2 - 


5 


1 




Northview 


2 


10 ^ . 


3 




Henry David Thoreau 


5 , 


1 


\ 




Total 


- - 1 

15 


34 


11 



66 




43 



1 



1977 . 



f . Unit Leaders Teachers Aides .Total 



tlcFarland ^5 9 ' 0 14 

2* 



Henry David Thoi?eau • . 1 ' 

*D.ue to the organizatioaal structure at Thoreau,' only^ the reading ^ 
specialist and terminal operator were surveyed". 

Analysis of 1975-76 Ugage 

.A total of 31 uses were reported: the grea^ majority of 
respondents llTsted no extra uses for any reports. No additional 

*uses for WIS-SIM reports were given. Blanks* were taken to mean that 
no extra uses were made of the reports.' The respondents from 
Barstow and Jackson reported little or no use Was made of the ° 
reports— Jackson, because of th,e^ late assembly t)f the dat^ base 
and the lack of a terminal in t^^^ir school building, and Barstow, 
because of the lack of a terminal in -their school building. 
Consequently^, no other uBes df re'poirts were identified by respondents 
from^ these two schools. Henry David Thoreau (although several 
respondents repor.ted uses') organizes its WIS-SIM services through 
the one person, a r^adinfe>Hgtcialist and, consequently, Thoreau 

,respondentsN:haracteristically dici not report many fextra uses of 
WIS-S^M reports. Most extra mses came from. McFarland respondents' 
with some fj^pm Northview and jpiover-Whiting. ^ In this report, where 
extra uses were mentioned b^ multiple users, this. J.s noted. 
Ofherwise^ it can be taken that extra uses wer^\repor ted only once. 

l^nit Performance Profile (UPP) . The use, of , the UEP as an aid 
^n evaluating instructional programs at the yearns end was 'reported 
by a unit leader from McFarland. Although not mentioned speciSi^lly 
byvthe respondent, it appears as -though the UPP^ contains useful 
information on progress in an .instructional program being made^ by a \ 
group of students and, over^ time, this helps' to assess the usefulness 
of a program in meeting the educational nfeeds of students. Several 
respondents pin th'e UPP cfn a board to permit students to' see what 
progress they' are making both individually arid as a groi^ . 

.Several rat^her conventional uses, related to the grouping of 
students were reported,' e.g.; u^ing tffe- UPP in deci^dlhg what skills 
to request, for grouping and in deciding where 'to place students 
who do not appear on the grouping recjf^mmendat'ions . However, three 
respondents reported using the UPP as an aid when forming groupings 
within classrooms. ^ • ^ , . 
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Individual Performance Profile (I^PP) , Four schools reported 
using IPP's during end of semester parent conferences. Two 
respondents noted that parents found the IPP's difficult; to comprehend 
However, it was also noted that achievements and deficiencies of 
individual students can be readily identified to the parents. The 
ready availability of current IPP's is also useful for quickly- 
convened conferences. 

IPP s have been used by at least three respondents when 
^students are transferred into and out erf sq,hools. IPP's can be 
sent to receiving schools and from sending sch^)ols as^ a convenieat 
means of communicating information on s'tudeht progress. One • 
teacher reported using IPP's as a means of communicating information 
to special services. * * ^ 

Similar to uses reported for the UPP, two respondents used IPP's 
to indicate to students hoj4,jJM»^were progressing and, in oiie 
instance, each studen^^'tJas given his own copy of the IPP*. The 
only other tfSe noted of the IPP yas by one respondent who nised it as 
the subject ot an introduction to uses of tl)e computer. No extra ^ 
uses were reported for the /Instructional Grouping Recommendation- 
Summary, the Instructional, Grouping Recommendation-Omissions, or 
the Prerequisite De'ficiency Report. ' , 



Analysis of Usage 

The respondents £rom the McFarland Schools indicated the greatest 
numbe^' df additional uses for the seven .reports addressed in the 
questionnaire. As indicated in Table XXIII, the instrument was^tot 
given to the teachers at/ Henry David Thoreau because primary use - 
of WIS-^IM and its' reports weba^made only by the feading specialiS't 
and aide in the reading center. The reports are listed separa1:ely 
in thjls section. When additional uses were Indicated, the design 
putT^ose is given followed by the r^spondent§' uses. 

Unit Performance Profile (UPP) . The design- purpose of the UPP ' 
report is to determine the achievement status of ^tudents. Uses for 
this r^ort indicated by the McFarland responden^ts in addition to 
the design purpose are^givep below. The number in parentheses 
refers to the pumber of -respondents identifying that' same particular 
use. . • 

'1. Identitication of st*udents refjuiring pretesting (3). 

^^"2. Determination of^Ti^xt topic to be. %^ug1i^to particular 
students. 

3. Grouping of .students (3) . ' 

4. Update inforfnation^^^ students . . > 

5. Evaluation of unit goals and objectives. - 'I 
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6. 'Record of moving students within school and 'from school*-to- 
^ school. ' ■ ' 1 

7. Use by gtudents* in keeping theii? own records. * 



T^e Thoreau' respondents Indicated the use of the UPP as class' 
charts in Word Attack and Study Skills. Duplicate charts are kept 
in the unit and the reading centeru-^* , 

Individual* Performanp^ Profile (IPP) . The purpose'' of tKe IPP 
is to provide achievement^ information fpr an individual student. 
Additional uses indicated for the report are: 

• 1. *^o d^terminef why a student Is not ready for a certain skill* 

'2. Recora "keeping and planning , of schedules by student. 

3. Student personal- records keeping. 

j 

4. Report for student leaving school (3). 

5. Parent-teacher conferences (6>. . ^ . 

\ r ' 

\ ' • 

6. Forming small instructional groups (2). . ' ^ 

7. Use when student isn't inc^iuded on a grouping recommendation. 

8. To facilitate teaching objectives with which students have 
difficulty. 

The primary additional use of th^ IPP indicated by the Thoreau 
respondents was the updating of a profile card vhen a stijdenc leaves 
the school. Other uses included use for parent conferences or when 
a student leaves the school. ' 

Instructional Grouping Recommendat ion- Summary « Thd function 
of chis report is to identify students who need instruction in the • 
skill requested. The onl'y additional use indicated for this report 
concerned assista^ice in identifying weaknesses of planlling and / » 
teaching strategy by presenting the needs of a group in an overall 
format. 

' ^^ Instructixma<r Grouping ^Recommendatioii-Qmission . No additional 
uses}were indicated by the respondents fo^ this report. 

Prereqiiisite Deficiency Report . The purpose of this r^pof^^ 
is to ^how Ch^ prerequisite achievement status of students 
ineligible for a requested topic. Additional uses indicated .are: 

1» To provide information as to why a student is listed on the 
omissions report and to specify objectiyes. ' ' 
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2. To help k^ep teachers accountable. 

3. To facilitate SIn^ll group work^ within large groups (2). 

Skill Eligibility Profile . The purpose of this report is to 
show the number, of students who have mastered a particular skill, 
how many are eligible, and^ how many arje not eligible because of 
prerequisites. Additional uses report^ed include: 

1. Determining where most students need skills. 

2. Determining which skills to teach (2). 

Instructional Groupijag ReGommendation-Group . No additional 
uses for this form were reported. 

Many of the stated uses related very closely to the intended 
uses; other uses mentioned take the- palace of other reports designed 
for the purpose. For example, the use of the UPP, "update information 
on students", or the use of the SEP, "determining whefi most students 
iteed skills", are closely aligned with the stated purposes* of the 
reports. The uses of the IPP, "grouping of students", or of the IPP, 
"to determine why a student is not ready for a certain skill", are 
uses tjrat replace other forms, the JGR and the PDR, r esi^bctively . 
Most of the uses noted, however, represent creative, additional uses 
of the reports. The project needs to determine the management needs 
underlying these uses, whether these are broadly' based, important 
needs, and the extent to which the reports generated, adequately 
meet the'se needs. 



Appropriateness of WIS-STM Forms ' ' 

The seven User schools were* asked to evaluate the appropriate- 
ness of WIS-SIM report and request forms in January 1976, by completing 
a rating scale on each form. Additionally, the respondents were 
asked to provide suggestions 'for improvement of the farms. Twelve 
forms were assessed, with the two performance profiles^ and three 
grouping forms further separated for DMP and WDRSD. In all, seventeen 
assessments were made. The rating scale used is shown in Appendix B. 
Appropriateness of WIS-SIM forms was not evaluated in 1977. 

All s^ven user schools completed the evaluation, but the 
results from the Plover-Whiting School were not received and are 
assumed lost along with the tasks^ identification results. This 
evaluation of WIS-SIM forms- was therefore completed' without informa- 
tion from Plover-Whiting, which used WIS-SIM for the -WDRSD program. 
-The results from the two McFarland schools are combined xindex the ^ 
school district name, McFarland. The McFarland Schools, Northview, 
and* Barstow, use WIS-SIM forms .for. both DMP and WDRSD. Jackson, 
Plover-Whiting, and Henry David Thoreau use only the forms for * 
WDRSD and, consequently, did not assess DMP forms where these were 
separately identified. 
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The respondents to this questionnaire were half of each of 
^school's staff. The complementary half responded to the Tasks 

Identification questionnaire as reported later in this chapter. All 
respondents were asked to assess forms that they had used previously. 
The varying numbers of respondents withia the" same school giving 
assessments for individual forms indicate that these instructions 
were followed. As a further consequence, eight selected teachers 
did not complete any sections, each^^aiming to be unfamiliar* with 
any forms. Limiting respondents'^'^sessments to forms that they 
had previously used shoudd yield more valid assessments than those 
from non-users. In all, AA responses were received: nine from 
McFarland, six from Jackson, .four from Barstow, twelve from Northview, 
and thirteen from Henr^^ David Thpreau. 
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/ . The purpose of the rating scale was to have users •assess. the 
appropriateness of the format of each WIS-SIM form. Usefulness of . 
these same reports was not assessed by this instrument; only aspects 
of the format ot design of each form was considered. Some aspects 
.of format include its^rrang^ent , spacing, size, and inclusion of ^ 
all essential data. Respondents were asked to suggest improvements 
to the format where they considered this necessary. A five-point 
scale was used with 1 representing appropriate to 5 indicating 
inappropriate. As well as providing ratings, respondents also were ' 
asked to suggest improvem€;nts for each form, where these were 
considered necessary. 

The results of the assessments of each form are shown in ^ 
Table XXIV. They. are reported separately by school, by all schools, 
and by all forms combined. The assessment for each form is shown 
both as a fraction and as a decimal. Por example, the assessment 
of. the Unit Performance Profile by McFarland .is 8/6=1.33 (see . 
Table XXI, column 2). This ^ indicates that 8 was the total assess- 
ment obtained from 6 respondents from which is obtained a mean 
assessment of 1.33 for the Unit Performance Profile. 

\ 

The mean assessment over all forms by All respondents. was 2.1$, 
with nine forms having ratings less than or equal to 2.19 and eight*' 
.forms having ratings of 2.19 or higher. Six forms receivedl ratings 
of 2.00 or less and eleven received ratings greater than 2.00 (see 
Table XXII). Only one form, the Prerequisite Deficiency Report, 
received a rating of greater- than 3 and is, therefore, considered, 
on the average by the ten respondents, to be inappropriate. 

The number of suggestions received from respondents was scant; 
Only 2:^ comments were received out of a possible 748. Of those 
received, 13 were made by McFarland users. Therefore, ' it appears 
fruitless to use resjK)ndents* ^comments as indications of what they 
found ilfTsatis factory, about the forms. Of the 23 comments, ten 
were not related to format; several more were uniAelligible. 
Specific comments made include ^he following: 

r • 



TABLZ XXI 



Forn 



t McFarland 



APrROPRIATE^TESS OF WIS- SIM FORMS* 
Mean Ratings by Schools 



Jackson 



Barsto'. 



Northview j H. D. Thoreau | All Schools 
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UP? - d:i? 

IP? - DMP 

- '.n'DRSD 

IGR - Group 

- DMP 

ICR -Summary 

- DM? 

- VDRSD 

IGR -Omissirsn 

- DMP 



! - WDRSD 

J ^ ^ 

. , Score Subi?.ission 
' Fo rn 

I ^ - ' 

j Card Iftserts 

Objective Check-^ 
list Cards 

Grading Update 
^Report Cards 

prerequisite 
/Deficiency 
Report 

Oil Request , * 
Form 

Student Status 
Report Form 



I 9 



/6 = 



11/7 = 
10/8 = 
13/9 = 



1.33 
1.57 
1.25 
1.44 



i 12/6 = 2.00 
! : 6/7 = 2.29 



9/5^ 
12/7 = 

10/4 = 
13/6 = 

23/6 = 
13/7 = 



9/6 = 
12/4 = 

10/5 = 
9/6 = 
•8/4 = 



1.80 

ir>i 

2.50 

2- 17 

3- . 83 
1.86 

1.50 • 

3.00 

2. do 
i.5q 

2.0^)- 



20/6 = 3.33 



6/2 = SJdO 



5/2 = 2.50 



3/1 = 3.00 



7/3 =2.33 I 10/4 =2.50 

10/4 = 2.50 i 20/11 = 1.82 

7/3 = 2.30 i 10/4 = 2.50 

10y4 = 2.50 ! 20/11 = 1.82 



3/1 = 
8/5 = 



^ - 



3.00 
1.60 



4/1 



= 4.0 



8^- .' 

3.0 ' 



9/3 = ,3.00 
12/4 = 3.00 

-a/3 = 2.67 
11/14 = 2.75 
I 

I 10-/ J = 3.30 
13/4 = 3.25 

12/4 = 3.00 
6/2 = 3.00 

. 6/2 = 3.00 , 

9/3,= 3.00 

8/3 = 2.67 . 
9/3 = 3.00 
9/3 y.3.0iL^ 



9/3 = 3.00 
25/12 =2.08 

8/3 =-2-.67 
24/12 = 2.00 

8/3 = ,2.67 
19/10 = 1.90 

9/-7 = 1.29 
472 '= 2.00 

4/2 = 2*. 00 

10/4 •= 2.50 

12/4 = 3.00 
7/3 = 2.33 
27/7 = 3.86 



25/13 = 



18/12 =1.50 i 79/40 = 
I 27/15 = 
21/13 = 1.61 i 70/39 = 



I 
I 



28/13 = 2.15 



30/12 
36/38 



26/12 = 



-I 25/11 
2.17 j 76/36 



20/10 = 2.00 



9/6 
3/2 



1.50 
1.50 



28/10 
,68/31 

61/28 
26/13 



3/2 = 1.50- 1 22/12 



4/2 = 2.00 

2/1 =2.00 
-9/4 



35/13 



1 . 97r 

1.8 
1.79 



2.50 
2.26 

2.27 
2.11 

2.80 
2.19 

2.18' 
2.00 

1.83 

*2.69 



32/10 = 3.20 



= 2.26 I 38/17 = 2.23 



5/3 = 1.67 



52/18 = 2.89 



I All Forms 



1.198/103 = 1.92 4 52/19 .= -i2. -74 



1.44/55 =2.62 



226/102 = ,2;21 



73 

' 148/80 = 1,^5'! 780/356 = 2.;i9 f 



^ .''Scale; l=Appropriace to 
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5=InaV>propriace 
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TABLE XXII 

WIS-SIM FORMS RANKED BY APPROPRIATENESS SCORES* 



1 

2 

3 

4 

5 

6 

7 

8 

9. 
10 
II 
12 
13 
14 

15" 
16, . 



(1.^*9) 



IPPV (WDRSD) 
IPP (DH^) (1.80) 
Objective Checklist Cards (1.83) 
UPP.(DMP) y (1.92) 
UPP pMP) (1.97) 
Card Inserts' (2.00) 
IGR-Summary (DMP) . (2.11) 
Score Submission Form (2.18) 
IGR-Omission (WDRSD) 
CMI Request Form (2.23) 
IGR-Group (WDRSD) (2.26) ' 
IGR-Summary (DMP.)\ (2.27) 
I6R-Group (DMP) (2.50)^ ' ^ ' 
Grading Update Report (Group) (2.69) 
IGR-Omission <DMP) (2.80).^ • 
Student St'atus Report Form (2.89) 
Prerequisite Deficiency Report . (5^. 20) 



er|c 



*Scale: l=Appropriate to 5=Inappropriate 




1. Four respondencs from Northview requested that 'the Studentj 
Status Report form be amended to be usable for more than | 
one entering student and that a separate form be used for 
leaving students (again, for 'mi^ltiple leavers). The views 
of these respondents may have been directly responsible for 
the low ranking of the Student Status Report Form. 

2. (a) Student names do not line up with numbers on the DMP 

Instructional Group Roster-Card Inserts. 

(b) A preference for the use of //2 pencils with Card* Inserts 
(one respondent). s ^ ' 

3. One respondent considered that more than three recommenda- 
tions on the IGR Omission form are necessary. ^ 

♦ 

4. The opening in the plastic holder for the Objective Checklist 
Cardfe should be widar to, facilitate. f iling in N, P, or M 
(one respondent). ^ ^ 

5. One respondent saw the need to include dther data on the 
Individual Performance Profile, such as standardized test- 
score's. 

6. One respondent preferred the- use of 8'* x 11*' printout sheets^ 
for Unit Performance Profiles and 'further recommended that^ 
faint lin^s would ,assist in reading the Unit Performance 
Profile. A 

7. One respondent considered the Ui^it Performance Profild^o , * 
contain too much information, buC\^ave no specific deta^.ls. • 

ttie r§.tijngs ar^ the small number of comments indicate that/ 
users feel, generally, that the f orm^ %are appropriate, with the 
e^^peption of th^ ?>rerequisite Deficiency Report. User suggestions 
should be considered in later revisions and updates of the system. 

USEFULNESS OF REPORTS ^M^^ 

^ In May 1976, the seveYi user sthools were asked to evaluate the 
usefulness of WIS-SIM reports by completing a rating scale on eadh 
of five* forms: *, ^ * 

Unit Performance Profile (UPP) . 

2. Individual Performance Profile (IPP). ^ - 

3. ^ l4istructional Grouping Recommendation-Summary 



4. Instructional- Grouping Recommendation-Omissions. 

... . . ^. 

5. Prerequisite Deficiency Report. 
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In April 1977, a similar^ evaluation was performed ' of the' above 
reports and the follov/ing additional reports: ^ 

1. *^ Skill Eligibility Profile. 

2. Instructional Grouping Reconmiendation-(iroup. 

The purpose of .this rating scale was trp assess the "usefulness of the 
in^rifnation contained in the reports for making decisions about the 
instruction of students. In addition to rating the forms on a- scale, 
the respondents were asked to make suggestions with regard to each 
of the respective forms. Those surveyed were asked to respond only 
about reports that they had used. 

The purpose of the rating scale .was to assess the usefulness of 
some WIS-SIM reports* to users. Aspects of informational utility 
include the relevance of the information to the decisions usprs make 
about the instruction of students, the adequacy of the amount of 
information, and the acburacy of the information. A 5-point scale ' 
was used with 1 representing very useful to 5 representing not useful 
for each item. Respondents were also asked to suggest improvements 
to the forms or their use where they considered this necessary. 
The instrument used in May 1976 is included in Appendix B.' The 
questionnaire used in April 1977 is consolidated with the question- 
naire al^o included in Appendix Bi , w 



^ ' Analysis of the 1975-76 Survey 

r - . . • ■ 

The numbers of respondents answering the usefulness questionnaire 
is summarized in Table fclll for each school and respondent type. 

• , / • 



s ^ TABLE' XXIII 

NUMBERS OF RESPONDENTS TO USEFULNESS OF. REPORTS 197^UESTI0NNAIRE 



Mc Far! and- ' ' „ 
Jjjckson 

Plover-Whiting 
Bars Low . 
NorLhview 
Thor«au 

AH Schools • 



Unit Leaders 

1 
1 
2 
2 



16 



Teadhers 
6 

■ 2 
2 

3 . 

7 

f 

"27 



Aidfes 

0 
1 
0 
1 

.3 
3 



All Staff 



erJc . 
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TABLE XXIV 

* * 

V USEFULNESS OF*i^EPORTS: 1976 ' 
MEAN RATINGS OF UNIT PERFORMANWi^^Om 



McFarland 
Jackson 

Plover-Whiting 

Barstow 

Northview 

Thoreau 

A3] Schoo]s 



Unit 


Leaders 


^ Teachers 


Aide 


s 




All Staff 


4/4 = 


1.0 " 


8/6 = 1.33 








12/10 = 1.2-- 






2/2 = 1.0 


2/1 = 


2. 


0 


4/3 = 1.33 


3/1 = 


3.0 


7/2 = 3.5 • 








To/3 =3.33 


6/2 = 


3.0 


13/3 = 4.33 


2/1 = 


2. 


0 


"21/6 = 3.5 


4/2 = 


2.0 


19/7 = 2.71 


5/3 = 


1. 


67 


28/12 = 2.33 


20/6 


= 3.33 


24/r^^t74V 


.9/3 = 


3. 


6 


53/16 = 3.3 


3-7/15 


= 2.47 


73/27 =2.7 


\8/8 = 


2. 


25 


128/50 = 2.56 



^ TABLE XXV 
USEFULNESS OF REPORTS: 1976 
^AN RATINGS OF INDIVIDUAL 'PERFORMANCE PROFILE ' ». 

Unit Leaders Teachers 



McFarland 


5/4 = 


1.25 


7/6 = 


1.16 


Jackson 


2/1 = 


2.0 


Jill = 


2.0 


Plover-Whi ting 


• 3/1 = 


3.0 


6/2 = 


3.0 


Barstovr 


8/2 = 


4.0 


8/2 = 


4.0 


Northview 


3/2 = 


i.5 


14/6 = 


2.33 


Thoreau 


• 14/6 -- 


.2.33 


.19/7 = 


2.5] 


All Schools 


35/16 


= 2.18 . 


58/25 


= 2.32 


• • 
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8/3 = 2./67 
2.32 24/8 = i.O 
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TABLE XXVI ^ * 

V . USEFULNESS OF REPORTS: 19-76 

MEAN RATINGS OF INSTRUCTIONAL GROUPING RE COMMENDATjiltl- SUMMARY 

» .. . . ' 

Unit Leaders Teachers Aides All Staff 



McF^irland 
Jackson 

Plover-Whiting 

Barstow 

Northview 

Thoreau 

All Schools 



5/4 = 1.25 lA/6 = 2.33 - 19/10 =.1.9 

2/1 =.2.0 A/2 = 2.0 ^1/1.= 1 7/4 = r.75 • 

3/1 = 3.0 .«/2 = 3.0 4jJf '"- 9/3 = 3^^^ 

6/2 =,3.0 11/3 = 3.67 3/1 = 3.0 , 20/6 = 3.33 

4/2 = 2.0 19/5 = 5.8 7/3 = 2.33 30/10 = 3-. 0 

8/6 ="1.33 , 10/7 = 1.-43 4/3 = 1.33 22/16 = 1.22 

28/16 = 1.75 64/25 = 2.56 15/8 = 1.88 -107/49 = 2.18 



/ TABLE XXVII 

USEFULNESS OF REPORTS: ' 1976 
MEAN RATINGS OF INSTRUCTIONAL GROUPING RECOMMENDATION-OMISSIONS 



Mc Far land 
Jackson 

Plover-Whiting 
Barsfcow 
Northview 
Thoreau 
11 Schools 



Unit Leaders 
10/4 = 2.5 

3/1 = 3.0 
8/2 =4.0 
3/2 = 1.5 
9/4= 2.25 



• Teacherg 
13/6 = 2.16 
5/2 = 2.5 
6/2 = 3.C^ 
8/2 = 4.0 



Aides " All Staff 
23/10 = 2.3 
5/2 = 2.^ . 
• 9/3 = 3.Q 

f 

20/5 ^ 4.0 



4/1 = 4.0 

19/5 = 3:8 7/3 =.2.33 ^9/10 = 2.9 
8/4 = 2.0 10/3 = 3.33 27/^ = 2. 45 



33/13 = 2.54 59/21 = 2.81 21/7 = 3.0 113/41 = 2: 
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TABLE XXVIII ^ 
USEFULNESS OF REPORTS: 1976 
MEAN RATINGS OF PREREQUISITE DEFICIENCY REPORT 



McFnrland 
Jackson 

Plover-Win Ling 

Barslow 

Northviev/ 

Thorcau 

All Schools 



Unit Leaders 
aO/A = 2.5 
4/2 = 2. a 
3/1^ = 3.0 ' 
6/2 = 3.0 
A/2 = 2.0 
^8/3 = <2.67 



Teachers 



s 



Aides 



All Staff 



16/6 = 2.67, 
15/8 = 1,88 
5/1 = 5.0 
10/2 = 5.0 
10/3 = 3.33 
10/4 = 2.5 



35/14 = 2.5 -66/24 = 2,75 



26/10 = 2.6 
19/10 = l;9 
8/2 = 4.0 
16/4 = 4.0 ' 
- 14/5 = 2.8 
6/2 = 3.0 24/9 = 3.78 
6/2 = 3.0 107/40.= 2.68 
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i 
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• TABLE XXIX 






• 




USEFULNESS 


OF REPORTS: 1976 








• 

MEAN RATINGS 


ON ALL. FIVE REPORTS 








Unit Leaders 


Teachers 


Aides • 


All 


Staff 


McFarland \. 


34/20 = 1.7 


58/30 =^ 1.53 




92/50 = 


. 1.84 


Jackson 


. 4/2 =2.0 


15/8 =,1.88 


6/3 = 2.0- 


25/13 = 


1.92 


Plover-WhiLing 


12/4 = 3.0 ' 


30/9 = 3.33 




42/13' = 


3.23 


^arstow * 


34/10 = 3.4' 


'52/12 = 4.33 


11/^4 = 2,. 7 5 


'97/26 = 


3.73 


Northview JBb 

'1 


'18/8 = 2'. 25 


81/26 = 3.U 


30/1 2 = 2.50. 


129/46 


-2.80 


Thoreau ^ 


L 59/25 =2.36 


71-/29 - 2.45 


37/U = 2-. 64 


167/68 


= 2.46 


'aJ] ^chooJs % 


161/69 =■ 2.'33- 


307/114 =.2.69 


84/33 = 2.54 


552/216 


= 2.55> 
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i» It should be noted that different categories of • users utilize 
the reports for different purposes and, conse4uently , these reports 
may have different degrees of usefulness for different users. 
Accordingly, Tables XXIV to XXIX are presented in terms of unit 
leaders, teachers, and aides. Administrators were omitted fronv the / 
survey on the assumption that they did not use the reports in their ^ 
daily work. 

Neither the Jackson nor the Barstow schools use WIS-SItl to the 
same extent as other user schools. General comments to this effect 
were made by many respondents from these two^schools, indicating 
they did not use the forms specified and, consequently, could not ^ 
assess their usefulness. An important factor is the different 
organizational structures that different schools us,e to implement 
WIS-SIM and IGE. 

At Henry David Thoreau, the reading ispecialist operates the 
system independently of other teachers a[%d, therefore, these teachers 
vrere not able to make rffiany assessments. Different personnel are 
jresponsible for different us^s of WIS-SIM in different schools and, 
consequently, their perceptions should be weighted to show these • 
dif feirential responsibilities. This wa6 not attempted in this 
evaluation; the perceptions ol all users being preferred and presented 
in terms of categories, ^ocal organizational peculiarities, where 
shown, can be taken into account .when interpreting Table'^IX^ 

The results of ^'this assessment are shown separately for each of 
the five reports bV, school 'and' by category of user. The .assessment 
for each form is ^shown both as a- fraction and as a decimal. This 
permits 'the reader.fto o^ote the number of respondents contributing 
towards the mean'rating of a particular form. . ' ^ * 

The. mean rating given by all respondents over ali reports is 
2.55 (see Table XXIX) with thelPP.and the IGR-Sumraary having ratings 
less than (more useful) this average.. The IGR-Summary report was 
seen by ^nit leaders apd -aides to be the most useful of all reports 
assessed. The IGR-Omissions report was seen to b"^ the* least useful 
compared with other reports, but is still rated as being useful, over- 
all. -'^n terms of assessments over ail schools and all users, > reports 
were ranked according no their usefulness as follows: ' ^ 

^ 1.' Instructional Grouping Reconmiendation-Summary (2.18). 

2. Individual Performance Profiles (2.39). 

ft 

. 3. Unit Performance Pi/ofiles (2.56). 
^A. Prerequisite Deficiency Report (2.-68). 
5. Instructional Grouping Recommendation-Omissions (2.76). 
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Unit/Headers consistently rated reports higher than did either 
teachers, or aides — the exception being the Unit. 'Per fx:)rraance Profile, 
which was rated higher by aide^. This trend is particularly notice- 
able for Northview and, to a lesser extent, for McFarland and Thoreau. 



The McFarland Schools consistently rated the usefulness of 
reports mgheir than did other schools, the exception being the - 
^^Prerequisite Deficiency Report. The mean rating on all five reports 
is presented in Table XXIX. / ^ 



The 'schools ranked all reports according to the degree of their 
usefulness as follows: « 



1. 



Rank ^ 


School 


1 


McFarland ^ 


2 , 


Jackson 


3 


Thoreau % 


' 4 - 


Northview 


5 


PloverTWhiting 


6 


Barstow 



Mean Rating 
1.84 
1.92 
2.46 
2.80 
3.23 
3.73 



Jackson also was consistently high (comparatively) in its assessment 
of all forms.' Barstow consistently ranked the usefulness of the 
reports low^^t. •! 

Based on the mean rating of ^11-schools, the reports considered 
most useful wexe th6 Ins^tructional Grouping Recommendation-Summary 
and/tbe Ind.ividual Performance Profile. However, it is doubtful 
that meaningful overall conclusions can be reached regarding the 
usefulness of reports by all schools. Usefulness must be judged 
relative to, and tempered by, the organizational structure and 
degree of WIS-SIM implem|pntation. In evaluating a low usefulness 
rating?,^one must question whether this results from a low level of 
system use and implementation or whether the low usage is* a function 
of the user's perception of a lack of systeiff* usefulness, including^ 
the reports. ' - 

Those forms with a rating of 2.5 or less should be considered 
useful, not presently in need of further modification, and their 
position in the WIS-SIMvneed not be altered. Those forms with a 
rating of greater^ than 2,5 should be investigated further with a 
view toward modification, of their role in WIS-SIM. 
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Analysis of the 3.97^-77 Survey 



The numbers of respondents answering the usefulness of reports 
questionnaire in 197 7 are summarized in Table XXX ♦ 



TABLE XXX 



•NUMBER OF RESPONDENTS TO USEFULNESS OF REPORTS QUESTIONNAIRE 

Unit Leaders ' ^Teachers Aides All Staff 

McFarland 5 . 9 ^ q ' 1A 

Thoreau . ^ ' ^ 1 '2* ' ^ 

*Only' reading specialist and termii\al opera-tjDr were surveyed • 

The results of the 1977 questionnaire regarding usefulness of* 
reports^ are presented in a different format than those in the 1976 
survey, included in the previous section; A total of lA unit leaders"^ 
and teacher3 were surveyed in the McFai^and schools. No aides were 
included in the 1977 survey. Only the reading specialist and the aide 
(ccmiputer-termin^l operator) in the reading center at. Thoreau \Jere 
surveyed as they are normally the only^ones who use the^repor'ts 
directly. < , ^ « 

The results of this survey are presented separately for each of 
the seven reports and by' user school,- The data are presented by the ' 
number of ' respondents rating each report, the mean rading given the 
report "by the respondents^ and the standard deviation of this , 
rating.^ Tables XXXI through XXXVII reflect the ratings of the seven 
reportJ^while Table XXXVIII refers to the mean rating of all Ithe 
reports, ^ * * , *• ^ , ' 

f The McFarland Schools, by far the largest users of the system, 
ranked the usefulnejss of-^he repojts as given below. Tli^^^mber 
in parentheses is the mean rating. ^ * . 



1." 


Unit Performance Profile (1.29). - 




2. 


IGR-Omissions (1.92), 




3. 


Individual Performance .-Profile' (2 


.08) . 


*4. 


Skill Eligibility Prof Lie ♦.^(2.20) . 




5r 


IGR-Summary (2.23).^ 










6. 


IGR-Group (2.38) . 




V7. 


Prerequisite Deficiency Report (2, 


40) . 
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McFarland 
Thoreau (R.S.) 

(Aide) 



y' TABLE XXKI 

USEFULNESS oV REPORTS: 19?/ 
RATINGS DF UNIT PERFORMANCE PROFILE 



N 
14 
1 

1 



Mean 
1.29 
1.0 
1.0 



Std. Dev. 



.61 



TABLE XXXII 
USER-I^NESS OF REPORTS: 1977 
RATINGS DF INDIVIDUAL PERFORMANCE; PROFILE 



McFarland 
Thoreau (il.b.) 



\ 



(Aide) * 



13 



Heaxj 
2.08 
3.0 
2.0 



Std. Dev. 



1.38 



TABLE XXXIII 
'USERXNESS OF REPORTS: 1977 
RATING OF INSTRUCTIONAL GROUPING RECOMMENDATION-SUMMARY 



McFciJrland 
Thoreau (R.S.) 

(Aide) 



N . 
.13 

,1 

♦ 1 



Mean 
2.23 
'2.0 
•2.0 



Std. Dev 



1.20 
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. TABLE XXXIV 



USEFULNESS OF REPORTS:' 1977 ' 
RATINGS OF INSTRUCTIONAL GROUP RECOMMENDATIONS -OMISSIONS 



McFarland 
Thoreau '(R.S.) 
^ (Alck) 



4 ^ 

' 10 

1 



Mean 
2,70 
3.0 
1.0 



Std. Dev. 



1,03 



TABLE XXXV 
USErcLNESS OF REPORTS: 1977 " ' 
RATINGS OF PREREQUISITE DEFICIENCY REPORT 



McFarland 
Thoreau (R.S.) 
- (Aide) 



N 
10 



Mean 



2.40 



(Not Used) ■ 



•Std. Dev 



1,08 



TABLE XX^I 
USEFULNESS OF REPORtS : 1977. 
RATING OF SKILL 'eligibility TROFILE 



^l.cFarland 
Thoreau (R.S.) 
' (Aide) 



10 ^) 

1 
1 



Mean 
2.20 
I'.O 
1.0 



Std^ Dev 



1.03 



TABLE XXXVII 
USEFULNESS OF REPORTS; 1977 
RATING OF INSTRUCTIONAL GROUPINQ RECOMMEKDATION-CJROUP 



McFarland 
Thoreau (R.S.) 

<Aide) 



4 



McFarland 
Thoreau (R.S.) 

'(Aide-) 



A 



N 

f 1 
1 



Mean 

1.0 
1.0 ' 



table" xxxViii 
usefulness of reports: 1977 

MEAN RATING OF ALl' SEVEN REPORTS 

' s 

■ N 



t 



86 
6 
6 



Mean 
■2.05, 
1.8jf 
1.33 



Std. Dev 



1.50 



S-td, Dev 

.r. 2p 

'^.52 



The unit performance prof ile,. continued to be rated as the most useful 
report and the prerequisite deficiency report rated as tlhe least 
useful, but still useful.- The rating of the IGR-Oraissions improved 
greatly between 1976 and 1977 

Henry David Thoreau ranked the usefulness of the reports high, 
as did McFarland, except for the Individual Perfotmance Profile 
which they indicated was rarely used. • The overall rankings of 
Tfroreau were highet, however^ than^McFarland^ This must be tempered 
by the f^ct that only^j:wo respondents were included in the Tlioi^pau 
survey. * * 

r ^ • y 

Given the high ratings oi the reports by Ihe twa user schools j 
it may be concluded that user perception of the usefulness of the 
reports is positive. These Wan ratings aie consistent with the 
previous year's survey; McFarland 's numerical ranking was .21 
higher and Thoreau' s was .63 lowa^rx^While the^se air^'not necessarily 
valid comparisons, the "^rankings ^o appear to indicate an, on-going 
and^ overall satisfaction with the jA^jefulness of the reports. 

* 

ASSESSMENT OF TASKS ^jFFECTEsT^Y WIS-s"lM 

User Identification of School Ta-sks Supported by WLS-SIM 

Certain school tasks are assumed to be affected by 'the use of 
corjputerized- procedures such as' the WIS-SIM system. Faculty^'S^id 
staff members were surveyed by means'of a questionnaire* designed to 
identify those tasks supported by the CMI system. This question- 
naire was administered to a random sample of staff me^l^ers in * 

i February 1976 end April 1977 . The 'questionnaire, which was prepared 
by project personnel, is shown in Appendix B. ^ " 

, ^ ' • o 

All seven user schools 'completed the quest ionriaire, but the 
1976 results from the Plover-Whiting School were not received, and it' 

' is^ a^^^iimed they were lost in transit. .Therefore,' this .evaluation 
was completed without infqphation from Plover-Whiting. The. results 
from the two McFarland ^chools were not considered separately and 
are combined under the%school district name HcFa.rland.* No school 
identification was ccTded onro the questionnaire forms used ip this 
survey.* Survey respondents we-re asked, however, to ind icat-^^tjietr 
position, i.e., administijator , 'teacher , aide, or unit, leader .-^ 

Staff lists for each schpol wer«.e ob%ar^|'d" and half of each 
school's staff was selected randomly to complete cfie^xjue'sttonnaire.* 
The remaining half qompieted another questionnaire., All respondents 
(1976 and 1977) were asked to identify those school\tasks that are 
supported by computerized procedures and 'rto indicate whether theii:^ 
role in the task^had changed as a result of WIS-SIM. A task s^uppprted 
by WIS-SIM was defined. as one that^ involved' the use of :corap\iter ' 
printouts .in carrying out^'the task. Fi-fUy-five responses were 
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received in 1976: sixteen from McFarl^d / five, from Barstow, twelve 
•/rom Northvi-ew, twelve from Jackson, and chitteen from Henry David 
Thoreau. Twenty-one responses were received in 1911:' fifteen from 
McFarland and. .six from Henry David^Thoreau. The 1977 respondents ' . 
did not include aides, first year teachers, or" administrators , as 
It wa^^^-fSIt- .their responses might tend to distort the findings. 
Also, due to the unique organizational structure at Thoreau, only 
the unit leaders and the, reading coordinator Were surveyed in 197 7 

Twexity-seven tasks were included in the questionnaire. Each 
wasjelected after a survey of ^ IGE literature ahjfethe questionnaire 
in^O^d. tasks considered typical for IGE schools.- Several tasks 
weie nicluded that' were considered as not invdlving WIS-SIM. fhere 
w^re'four possible responses to ^ach ta§k, ;and respondents , were asked. 
to select tKe one that best described the i'nvplvement of WIS-SIM 
.in the task. The possible- responses were: 



1. ' Th^ cask involves a WIS-SIM procedure that fias completely 

replaced a manual procedure. 

2. .The task involves a CMI procedure that has partially 

replaced a manual^procedure. 

3. The task is new .^d ^tra because of WIS-SIM. ^ 

. 4. .The task has nofbfien affected by WIS-SIM. 

For each task, respondeTtts were^also ^sked to indicate whether 
their role or responsibilities in the task had changed because ^of > 
.WIS-^, Responses wec^^ either Yes or. No. Respondents were also 
^ asked to identify^any computer-supported tasks not inc-Iuded , in Jbhe 
questionnaire. . f ' 

\t should be^HOted thra t . the *quest ionna'ire was designed to 
identify those school tasks supported by computerized procedures and 
, those affected ^by VIS-SIM. User Evaluation of the system was not 
■ the j*ri)ose, nbr vere user valqe judgement^of the /^f f ectiveries'S or 
efficiency oi' the system requested.' Therefore, phe results obtained 
cannot be interpr(^ted as measures of user ^satisfaction or* dissatisfact 
with the system. ' ' . ' 

- Tables XXXIX through XLIII show, for-ea'dh school, the^ percentage * 
/of respondents "delecting each of th<r four possible resp^^nses.. 
Tables XLIV show^those percentages for all user schools combined. 
In enc^h table, c^^umns 1-4 refer to tfte first aspeqt of WIS-SIM's" 
involvement in the task and columns 5 and -6 refer tu the role of * 
each- respondent in , the f^sk. N'ot all. percentages add to 100 percent 
because some respondents did not^'provide infermation'on each of the 
27 taskis,. ■ ' • 
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' Analysis of 1975-76 Survey 

In ,,the 1975-76 survey, only two tasks, "Maintaining Unit PerfprmaRce 
Profiles'^ (yPP) , task 3, and ^''Updating Studenc Performance Infoi;ma- 
tion", task 24, were considered by more thah 10 percent of the 
respondents as being new and extra becXjise of. WIS-SIM. The Jackson 
School identified more tasks, moreiNPtrongiy , as being extra because 

> of WIS-SIM than did any oth^ school. Ten out of -the twelve Jackson 
respondents saw '^Identifying Individual Student Instructional Needs", 

^ task 21, as' b*^ing ^xtra because of WIS-siM; seven identified ' 
"Maintaining UPP'^ as extra; five identified I?P's as extra*; five 
identifi^ "Updating Student f^e^formance In/ormatiop" as extra. It 
seems that Jackson's respondents have perceived WIS-SIM as providing 
ffl6re extra tasks than in other ,schoQls whQse respondents only 
occasionally referred to «tasks as being exlra because of WIS-SIM. 

^ Columns 1 and 2 of Table XLIV provide information on respondents' 
perceptions of the extent WIS--SIM's involvement in different task^, 
and column 4 provides the complementary information dn tasks hat 
affected by WIS-SlM.^ Thirteen of the twenty-seven tasks were noted 
by more than fialf the respondents as beir^aj af f ectecf by WIS-SIM 
(found by totalling the percentages in columns 1 and 2). .Those tasks 
most, strongly perceived as being^f fected by WIS-SIM were: 

1. Grouping Students for Instructional Purposes - task 11. 

' ■ . K . 

^2. Maintaining IPP - task 4. 

3. Maintaining UPP - task .3. 

4. Identifying Individual Student Instructional Needs - task 1. ^ ^ 
3i- Updating Student Performance Information - task 24. 

All other tasks were perceived b,y, more than 40 percent of respondelits 



as not being affecteid by WIS-SIM|nor as being extra because of WIS-SIM. 
Table XLV lists the tasks in otflbr Of magnitude of perceived Effect 
by WIS-SIM. ,y • . ' ^ 



Table XLIV. also reveals that proportionately_^tew respondents 
considered chat WIS-SIM had completely replaced a/manual procedure 
.(column 1). Maintaining UPP*s , maintaining IPT'^s, and assessing 
studefit learning outcomes Wieye th^ oftly task» that* were "considered 
by 25 percent or more of the respondents as involving a'gomplete 
change to WIS-SIM procedures. 'Eig^ht tasks were identified by at 
Aeast 25 percent of McFarland respondents as being completely 
p§>tf grmed ,by WIS-SIM procedures. 'Thoreau respondents placed six 
.tasKs in this category, and Noi^'thview respondents ^o^ placed four 
ta^ks.. BarS^tow, which infrequently used the'system, and Jackson, 
new user of ttje system, placed no tasks in this category. 
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, . T}\e information in cPlumn 2 of Tables XXXIX through .XLIV show 
respondents' perceptions of those tasks^ partially replaced by WIS-SIM 
procedures. Se\Xenteen tasks we're' perceived by at least ^5 percent 
of respondents as being partially supported by WlS-SIM. I^ine tasks, 
.were perceived by at least 40 percent W respondents as beirvg partially 
supported ,by WIS-SIM. .These data indicJ^^ thg use of WIS-SIM procedures 
for many school-related tasks. Diverse e\icatienal tasks such as' " 
evaluating learning activities with respec^o unit goals, assessing 
the status of entering students, reporting sftudent progress to parents, 
maintaining permanent school^.records of strident s' progress, determin- 
ing the rate of i^ogress^ of \nd ividual sfudents, and determining 
'Students' readiness for the next instructional step indicate that 
the effects of WIS-SIM are being felt in a^ wide variety of educational o 
activities. These effects are more evident when the results of 
columns 1, 2, and' 3 are considered jointly. The «*iorthview and 
McFarland respondents perceived more tasks as being affected by 
WIS-SIM than did Barstow (alm'ost a non-user) or the nfewer users from 
Jackson and Henry David Thoreau. 

. -The same tasl^s perceived by 'respondents as beirig most affected . 
by WIS-SIM were also noted by most respondents as involving role 
changes.). Table XLV^ is a list of tasks ranked in order. of those " 
produciQfe most changes in rales as perceived^by respondents! The . 
strong cor^relation between ranks by effect of WIS-SIM and change in - 
role is noticeable-, the Spearman Rank Order (Correlation being .95 
w^ich'is significant at the .'0001 l^evel. *• ^ 

Although three ij^r scho^ols used WIS-SIM' in the management of 
only one instructional program, and although Barstow infrequently 
used the system, it is evident from the data presented that WIS-SIM 
is having a significant effect 'on a number of important educational 
tasks, as perceived by users. 

i The fo^owing two list^ indicate those tasks that WIS-SIM 
was expected to afject, and those tasks which WIS-SJM was not 
exp.ected to affect. List^c^ after each task is the percentage that 
in ^ch category at^lea^t 50 percent of the teachers would respond 
in the anticipated direction. Such is the case in 1^ of the 27 
cases, with the remaining six cases being within 5 percent of the 
30 perujent goal. • ■ a • . ^ - . 



Tasks Anticipated to be Affected by WIjS-SIM 



-6 



ERJC .. 



1. identifying individual student irfktructional* ne'^ds (69) 

2. /Ps^essing student learning outcomes (45). 



Maintaining uni^ "pertorpiance profiles (70)?^ 

Maintaining individual performance profiles (71) 

. • . "J ^ 

Assessing attainment' of unit goals (45). 



•89 
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TABLE XXXIX • 
SCHOOL TASKS AFFECTED BY WIS-SIM. 
' MCFARLAND SCHOOLS 

Percentage Response s 

1975-1976 



N = 16' 



Task 



1. liientifying individual 
student instructions 
. neede 



Completely 
Replaced by 
WIS-SIM 



Assessing student 
learning .outcortes 



Maintaining unif: 
performance proTil-es 



^- KyPitaining individual 
/rof lies 



-^v..^- — 

5. Comparing the status of 
students in unit to 
scitQol, ^system or other 
norms* , 



12 



62 



50 



'6. Assessing the attainma^^ 
of \Jhic goals 



7/ Assessing the attainment 
of individual student, 
goals 



J 



Partially 
Replaced by 
WIS-SIM 



'56 



Exfra 
Becausa of 
WIS-SIM 



Nbt Affected I Your Role Changed 



56 



31 



50 



0» 



19 



12 



19 



> 



50 



0 



37 



' 56 



ERIC CO 



XT 



by WIS-SIM 



Yes I No 



0 



3i 



75 



19 



56 



75 



-87 



62 



25. 



50 



69 



44 



25 



J 



12 



62 



44 



I- 



31 



ox 



i '■. 

! • ■ ■ 

J Task 


Completely 
Replaced- by 
WIS-SIM • 


Partially 
"'Replaced by 
■ WIS-SIM 


Extra 
Because of 
WIS-SIM • 


1- 

Not Affected 
by WIS-SIM 


Your Role Changed 


Yes 


Ko ' 


8. Formulating unit ' 
goals , 


6 


12, . 


6' 


^ 

75 


^ 

19 . 

i 


75 


9- Developing instructional 
objectives for each 
child in the unit 


6 ■ 


37 ' 


6 




50- 

i 


r 

50 


i 4 

J 10. Evaluating learning 

j ^^ctivities with respect 

I to unit goals * f - 

r 


0 

i 


> 

50 

> - 


12 


37 > 


25 


* 

75 * 


11. Crouping students for 

instructional purposes " ' 

1 


25 


75 ' ' 


. 0 


* 


69 

• 




[ 12. Coun?e||tng students^ 

about their progress ^ A 
[ and future schooling 


>6 


■ - 

31 


6 


56 


31 

\ 

! 


' 56 


13. Se.lecting appropriate 
;r:aterials, medi^, and 
supplies for instruction ^ 


0 


. . 12 


0 


V • 87 


i 12 - 


75 

1 


14. Evaluating Unit 

operation ^ . . ^ 


*' - 12' 


. ' 19 


6 


56 

t 


19. 


62 


\5. Assessing the status of 
' entering students* 

n. . • . ^ : 


19 


"50 


0. ; 

1 


\ 

31 

<• 


50' 

1 

\ \ 


44 



ERIC 



» ' 1 

Task 


Cdmpletely 
Replaced by 
. WIS7SIM 


P^tially 
RepMced by 
Wlk-SIM 


Extra 
Because of 
WIS-SIM 


Not Affected 
by WIS-SIM 


0 D 

Your Role Changed 
Yes ; No 


1 71 ' ' 

j 16. Maintaining school^' s 

; inventory of 

j instructional iTiaterials . 

t-f -~ 


6 




0 

! 

1. 
1 


87 


0 


1 
1 

81 

1 


17. Reporting school's 
progress to cenferal 
adninistration ^ \ 

I ■ 1 


19 


A4 


1 

6 ^ 

\ 

t 


19 


50 


31 


18 4 Reporting sbudent , 
, p.rogress to parents 


12 * 


69. 


0 




" 81 


19 

y 


19- Maintaining permanent 
j ' school records of 
, . students/ progress 


12 


56 


6 


19 ■ 




< 

75 


25, 

- 


j 2,0. Develop:jjng daily 

teaching schedules 


0 ' 


19 

• 


12 


69 ' 


/ 


75 ^ 


/X. Assessing students m 

terms C\f their learning 
characteristics 


6 


0: 

I 


6 


87 <*^.s 


D 


75 


22.. • E^^luat:ing instructional 4 
progra?ns (e. g. SAPA,' ' 
WDRSD, DMP) 


6 


25 

V 


t 




7 
31 


62 


23. Communicating student ^ ^ 
information to state 
. agencies * 

^ . * 


D 


11 ^ . 1 

1 

'1 


■ ' _ 

12 


31 

4 1 


25 


56 

1 

*9 




• I 2 3 • A * • V - ^ • 


} ^ * 

• ' , Task ' 


^^Co.-np lately 
Replaced by 
' WIS-SIM 


i Partially 
1 Replaced by 
WIS-SIM 


Extra j 
Because' of | "Not Affected 
WIS-SIM' i by WIS-SIM 


1 

Your Role Changed 


Yes ' 


No 


I 2.4. Updating student 

^ * perforrrance inf crmation • 


44 


56 


* 

r 

o' 


1 

0 


81 


1 


. 25. yarking^r scoring 
1 tests 
! ' ^ 


6 


6 


6 

4 


81 


D 


81 


1^ 26. Deterir^ining rate of . ' 
'progress of individual » 
students 


37 


■ 44 

4 


6 


12 


56 


44 


• 27. Determining students^ 
j readiness for the next 

inscrucxionali^step j 

~ ^ ' • * ; 


44 

I 


f 

56 ■ - 


0 

y 


0 

1 


81 


19,-. 

1 



''G: 96 



ERIC 
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■TABLE XL . > 

(SCHOOL TASKS;AFFECTED BY.WIS-SlM 

Per.y'e'titage Responses 
A975-1976. ' 



N =.12 
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Task 

i 


Completely 
Replaced by 
WIS-SIM 


Partially 

Replaced by 

'^WIS-SIM 
-j — 


Extra 
Because of 
WIS-SIM 


Not Affected 
by WIS-SIM 


/I Your Ro] 

Yes 


0 

Le Changed 
.'No 


8. Formulating unit 
. gcyals 

— • i ' 


< 

0 


8 


8 


83 


0 


100 


] 9. Developing instructional 
objectives for .each 
child in the qnit 


0 


17 


33 


1 




100' 


i 

10. ^ Evaluating learning ^ ' ^ 
activities with respect 
to unit goals 


0 


8 


0 


83 


< 

0 


100"--' 


# 

11. Group^^ng staden^ts for 1 
instructional purposes 


0 


33 ^ • 


33 


33 


17 


83 


12. Counseling students 
about their progress 
and future schooling 


' 0 


0 


8 . 


92 

< 


8 


92 


• V 

13. Selecting appropriate 
materials, media, and 
supplies for instruction ^ 


0 


8 


\- - 

; ° 


92 

> 


8. 


} 

92 


14. Evaluating unit 
cfperation 


0 


17 


0 


83 • 


-n - 

8 


92 


15. .Assessing the status af 
entering students 

Lin 


0 

1 


' 25 


' 1 0 


75 . 


17 

r 


83 



ERIC 



1 __2 3 A • 5- 6 



Task 


Completely 
Replaced by 
WIS-SIM 


Partiall^' 
Replaced by 
WiS-'siM 


Extra 
Because of 
. WIS-SIM 


»^ ' 

Not" Affected 
by WIS-SIM 


Your Rol( 
Yes 


s Changed 

No 


16. Maintaining school's 
inventory of ' 
instructional materials 


.0- ■) 

* 


0 


0 


100 


0 ■ 

f 


100 


17. Reporting school's 
progress to central 
administration . 


0 


•0 


8 


— • ; '— 

92 


8 


92 * 


18. Reporting' student 

progress to parent^ - < 




8 - 

\ r- 


17 

i 


0 


75 


8 


92 


1 / - * . ' 
19. Maintaining permanent 

_gchool ire^rds of 

student:^ progress 


0 




i 


75 


"17 


. 83 


^20. De^loping daily >' 
teaching schedules , 


0 


H 


. <§' 


^ 

83 




92 


21. Assessing stepients in 

terms of their learning 
characteristics 


0 


~1 ~^ 

f 17 > . 

, 1 


,- 0 
. * - 


83 


' 8 


92 ' 


22.' Evaluating instructional 
programs (e.g., SAPA, 
» WDRSD, DMP) 


0 


; 17 


\ 0 


■ ^ 83 


.8 


* 92 


» — - 

23. Communicating student 
information to s^tate 
agencies 


0 


^ 

^ 0 
i 


.8 . 


92 


a 


uoo 



<^ 102 
ERIC ^ 



1 ' 

! ■ . / 

; . Task _ - ^ 


* Complet;^ly 
Replaced by ^ 
WIS-SIM 


Partially 
. Replaced bjy 
WIS-SIM 


• • 

. Extra 
Becausd of 
WIS-SIM 


Not Affedted 
by WIS-SIM 


Your Rol 
-Yes 


e Changed 
Ko 


i 

24. Updating student / 
• ' pierformance information 

^ 


0 


17 


42 


42 


1^50 - 


50 


25 » Marking or scoring^ 

tests ' ' ^ 

J 


0 


8 


0 


92 


8 




! 9 

26. Deterikining rate of 

progress of individual 
students 




I 

\ 


0 


' 92 


8 - 




27. Determining students* 

• readiness for the next » 
j instructional step 


0 

a 


. 17 

V • 


0 


i 

.83 


8 

f 

1 


92 



to 



. 104 



105 



er|c 



'A 
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JABLE XLI 
SCHOOL TASKS AFFECTED BY WIS-SIM 
' BARSTOW^ SCHOOL 
Perc entaSi^ Respon ses 

1975-1976 



r — 

Task 


Completely 
Replaced by 
WIS-SIM 


Partially 
Replaced by 
WIS-SIM 


Extra ^ 
, Because of 
WIS-SIM 


Not Affected 
-by WIS-SIM 


♦ J - 

Your Rol 
. Yes 


j 

e Changed 
No . 


1. Identifying individual 
student instructional- 
needs 

* — ■ - - — * 


u . 


'OU 




20 


• 

^ 0 


(■ 

^ 100 ^ 


2. Assessing student 
learning outcomes 


0 


60- / 


0 


'40 


^ ' 

0 


100 


3. Maintaining unit 
j ^ ' perforniance profiles 


0 • 

ir 


80 

V 


0 

< » 


20 


0 


100 


4. Maintaining individual 
profiles , » 

> 


6 


80 


0 


20. 


* 

0 


100 

• 


5. Compa^ring the status of 
students in unit to 
school,, system or other 
norms 

• t. 


. 0 . 


_40 

t 


" 0 


60 

% 


-0 


100 


6. Assessing the attainment 
of ujiit goals ^ 


i 

0 


1 

^ 40' 




60 




V>iQO 


^ 0 ^ — r 

7. Assessing the attainment ^ 
of individual student ] 
goals 

!?r- 1 WW ^ ^ 


0 


AO^ 

/ ■ 


0 


; ■ — 

60 ■ 

T 1 


•o'' 


. 100 

i r\v\ * 









'. 1 

1 


0 

. 2 


. 3 


■• 4 • 


• 

5^ 


'6 


• 




1 


>• 


Completely 
Replaced by 


Partially 
Replaced by 


Ext fa 
Because of 


Not. Affected 


Your Role Changed 


* 

i 

1 






Test y 


WIS-SIM. • 


WIS-SIM 


WIS- SIM 


by WIS-SIM •> 


Yes 


No 


• 


i 

1 ♦ 

1 


Formulafing uait 
goals 


0 


40 


0 


60 


0^ 


100 


1 

^■ 

L . 


• 


i 

i 

1 

i ■ 

! 


Developing instructional 1 

objectives, for each* 

child in the unit 
* 


0 


20 


0 


80 




100 






1 

i 10. 

1 • 
1 . 


Evaluating learningv 
activities wiLh respect t 
to unit goals 


0 


20 




80 


0 


100 


• 




11. 

! 


Grouping students for 
instructional purposes 


0 


80 


0 


■ 20 


0 


100 






12. 


Counseling' students 

about their progress 

and future schooling ^ 

■ — ■ ■ -1 


0 


20 


0 


80 

) 


0 


iOO 






13. 


1 

Selecting appropriate 
materials, media, ^and 
supplies' for irtstruction -t 


^ 0 


0 


0 


100 ■ 


20 


80 






14. 


Evaluating unit 
operation 


0 


80 ^ 

* / 


0 


' 20 


0 


100 






15. 


Assessing the status of 
entering students ^ 

; 


, 0 


20 ■ 


0 

1 


80 

i 

t 


0 


100 . 

1 

1 


09 • 




^ ^ \ 
1 ■ 


\ 






( 


* 


















> * 






« - 



! 

[ . ' Task' 


Completely 
Replaced by 
WIS-SIM* 


Partially 
Replaced Sy 
WIS-SIM 


Extra 
Because of 
WIS-SIM. 


Not Affected 
by WlS-SIM . 


Your Role Changed 
Yes j No 


16. Maintaining school 's- 
inventory of " 
instructional materials 


0 


20 


0 


80 


0 

i* 


100 


17. Reporting school's 
progress to central 
administration 


0' 


20 


0 


80 


0 


100 


18. Reporting student 

progress to parents 

^~ : 


0 


60 ' 


d 


AO — ^ 


20 


80 


19. Maintaining permanent 
j school records of ^ 
students* progress' 


0 


80 .. 


• . "* 0 






100 
X 


20. Developing daily 

teaching* sTrhedules 

— ^ ■ '-j^ : 




0 


* 0 


m 


0 


100 


21. Assessing students in 

terms of. their learning 
char^jctef istics 


0 


0 


0 

« 


100 
% 


. 0 

f 


JOG ^ 


22. Evaluating instructional, 
programs (e. g. , SAPA, 
WDRSD, DMP) 


0 


40 


. 0 


V 

60 


n 




23. Communicati'ng student » 
information to state " ' 
agencies. 


■ 0 

* 


20 


0 


80 

1 


\ 

0 

1 


100 



9 


Task 




. Completely 
Replaced by 
- WIS- SIM 


Partially 
Replacjsd by 
.WK-SIM 


Extra 
Because of 
WIS-SIM 


Not Affected' 
by WIS-SIM 


0 , 0 
Your Role Changed 


y4s ^ 
\ 


No 


24. Updating st 
perfornauce 


jlnformaticn 


0 


60 • 


• ' 20 


20 , 


20 




i 

25. Markicig or 
testSi 

1 


I . \ ■ 
Scoring 

I . / / 

1 — ■ ; - . 


•») 


0 

^ 


0 


100 


n 
u 


lUU 


26. .DeterniningI 
. progress off 
^ st^d^nts t 


rate of ' ' 
individual ^ ■ . " 

/ "' ' 


0 


'60 


0 • . 


40 


ij 


100 


27. Deti 
rea 

ins 

— — 1 r" 


erniir4ing students* ' 
diness for ^ the next 
tVuctional step. 




60 


h 

0* 


40 

*- 


0 


100 



/ 
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TABLE XLII 
SCHOOL TASKS AFFECTED BY WIS-SIM 
NORTHVIEW SCHOOL 
Percentage Responaea ^ 

. ' 1975-1976 



N ? 12 



Task \ 


Completely 
Replaced by 
WIS-SIM 


Partially 
Replaced by 
WIS-SIM 


• Extra 
Becaus-e of 
WIS-SIM 


Not Affected 
by WIS-SIM 


Your "Rol 
' Yes, 


.e Changed 
No . 


1. Identifying individual 

. oLUUtrllL JLIlb L LucLionaj. 

needs 


'33 


> 58 


0 


0 


50 


33 


•* * 

*- • rai?Jl>eij o J.ng bLUQeuL 

learning outcomes 


o 


« 

42 


17 


\ : 

25 

1 


/ 


I 

42 


3. Maintaining uaif 

performance profiles 


42 


50 


0 


. \ 

0 


50 


33 


I '4. Maintaining individual y * 
profiles ^ 

1 — ' ^ — i— 


42 ' 


50 


0 


0 


42 


42 


5. Comparing the status of / , 
stucjients in unnit to* r 
schpol, system or other 
nojms 


8 

r 




0 


_ 17 

^ 


0 


58 ' 


6. Assessing the attainment 
of ,unit goals 


' 8 


42 

• 


0 


1 

\ 25; j 
. j 


25 


58 ' 


7. Assessing th^ attainment 
^ of individual student 
goals 

< 


. 17 


50 

« 


0 ~ 


'25 • 

■ c 


H- 

1 

50 


33 

1 



115 



/Task 



j 8. Formulating unit 
' goals * 



j 9. Developing instructional 
' objectives for each ' 

* ► child in' the unit 



10, Evaluating learning, m 
activities with "respect 
to unit goals ' - 



11. Grouping students for 

instructional purpose^;^ 



12. Counseling students i 
about their progress ^ 
and future schoolings ' 



13. Selecting appropriate 
materials, media, and 
supplies for Instruction 



14. Evaluating unit 
operation 



lljC_ 
ERIQ 



15. Assessing the status of 
entering students 



Completely 
. { Replaced by 
WIS-SIM 



17 



Partially | * Extra 
Replaced by | 'Because of 
WIS^^SlM !• WIS-SIM 



25 



0 • 



50 



Not Affected •! Your Role Changed 
by*.WIS-SIM ■ Yes \ j No 

--^ i — . 



33 



• 8 



17 



■ 50' 



50 



17 



17 



. 0 



17 



> 33 



58 



42 . 



25 



17 



25 



25 



25 



50 



17 



"58 



00 



58 



58 



33 



50 



75 



50 



58 
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1 - 2 " • 3 - • 4,5 6 



* Task 


■ 

Completely 
Replaced by 
WIS-SIM 


Partially 
?,eplaeed by 
WIS-5IM 


E^^tra 
. Because of 

• WIS-SI^^ 


Not Affiected 
. by WIS~SIM . 


Your Rp"! 
Yes 


.e Changed 

• - '^No- 


16- Maintaining schoor's 
inventory of ^ 
instructional materials ^ 


6 


8 ' 


0 


42 


0 


-75 . 


17. Reporting school's 

progress to central . * 
administration ' ■ * 


. 17 ^ 


0 


0 • 

i/ 


17 




8 


42 


>^ 

18. Reporting student 

progress to parents 


0, 


50 


% 

8 


. *. 8 - 


^ 17 


42 


19. Maintaining permanent 
school records of 
students* progress 


25 


. 33 ■ 

r 


17 


- 8 . 

4 




50 


33 


« 

, 20. Developing daily ^ 
teaching schedules 

f ^ 


0 


8 


0 


• _ ■ 42-V 


0 


^ 58 


21. Assessing students in 

terms of their learning 
characteristics 


0 


, " 8 


0 




42 


0 


58 


i 22. Evaluating instructional 
programs \e.g. , SAPA, 
WDR§D, DMP) 

. — \ 


0 


= 17 


8 ^ 


17 

V 


" 0 


58 


23. Communicatljig student 

information to state / * 
agencies ' • ' 
1 • * 


0. 


. 0 




25 


T- 


*^ 

42 



er|c lis 



. ■■/ ^ ■ 


1 


2 


3 




5 


6 




Completely 
• Re^la<:ed by 


■ Partially 
Replaced by 


Extra 
'Because of , 


X- 

Not Affected 


> 

Your Role'Char.ged 


Tssk 


WXS-Sl-M 


. WIS-SIM 


WIS-SIM 


by WIS-SIM 


Yes 




1 .opuauing scuaenc 

performance information* 


U 

s ^ 


C Q 
DO 


1/ 


s 




• . 

. 25 <: 


J •ic-.^TCxng, or scoring 

! tests J, " ' 

i 


U 


0 


17 • 


50 


• 17 
* 


58 


* : > — ^ — »- 

■ t 

' j 26/ Deterniining rate of 
j ' progress of individual ^ 
' students 


• *8 - / 




8 . 

@ 


17 • . . 


, 17 ■ 


42 ■ 


' ! ^ * 

j 27. Determining students*"'' 
^ I readiness for tiie next « 
' 1 instructional step 

, 1 • • ■ 


8 


50 


17 


> 

.8 


42 


1 

^ 42.«.-- 

' 1 

! 

i 














* > 














- 


V- '120 ~ 

-4 ^ 


H 


/ 








i 



00 

o 
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• ^ TABLE XL IT I 
SCHOOL TASKS AFFECTED BY WIS-SIM 
^ HENRY DAVID 'tHOREAU SCHOOL 
Percentage Responses ^ 

1^75-1976 



^<z7N-= 13 



Task 



Identifying individual 
student instructional 
needs ^ 



Completely 
Replaced by 
WIS-SIM 



23 



Partially 
Replaced by 
WIS-SIM. ' 



38 



Extra 
Because of 
WIS-5IM 



Not Affected 
by WIS-SIM 



15 



Your Role Changed 



Yes 



A6 



No 



2? Assessing student 
learning outconies 



38' 



15 



54 



38 



3. Maintaining unit 

perEorniance profiles 



54 



j 4. Maintaining individual 
■ I *^profiles 



j, 5f Comparing the status of 

i students^ iji unit to 

; schlibol, system or other 

: norms 



' 46 



15 



46 



62 



38 



85 



23 



38 



8 ' 



69 



6. Assessing the attainment 
of unit goals 



38 , 



7. Assessing the attainment 
of individual student 
goals 



31 



38 



38 



ERIC 122. 



15 



15 



62 



00 



62 



123' 











\ 

1 


. 2 • 


3 


4 


5 


6 


/ 




1- 
1 

1 


■» 

Task ' . 




Completely 
^ Replaced by 


Partially 
Replaced by 


Extra 
•Because 


I- 
1 

Not Affected 


Your Role Changed 


/ 




1 
! 




WIS-SIM 


WIS-SIM 


WIS-SIM 


" by WIS-SIM 


Yes 


j No 






i 8. 

! 


Formulating unit 

goals 




0 <^ 


54 


0. 

i 


15 


IS 




00 


- 


• 9. 

i 
\ 

! ' 

i 


Developing ins.tructional 
objectives for each 
ch^d ,in the unit 




0 


31 


0 


46 


8 


- 69 

< 




- 


jio. 

j 

! 
t 


Evaluating learning 
activities with rep^ect 
to unit goals • 


« 

* 


' • 8 


31 


0 


38 


Q * 
o 


AO 
D y 


• 




i 11. 

1 
i 

I 


Grouping -students for 
Instructional purposes 


- 


54 


46 


0 


0 




H U 




\ ■ • 


12. 


Counseling* students 
about their progresSL 
and future schooling 




0 


23.' 


o' 


46 

J 


8 


69 


'■ 


- 


13. 


Select ing^ppropriate 
materials, media, and 
supplies for instruction 

^^v 




0 


8 

f 


0 


77 


0 








1^. 


Evaluating unit 
operation 




0 

t 


31 


0 

XT 


46 


8 


69 




12' 

1 


15. 


Assessing the status of 
entering students 7 




. 8 

< 


54 

1 


. 8 


31 




54 


125 




1 

r 




,* 




--■ 


o 


, V 

i 




















• 









Tas,k — • 


Completely 
&6placed by 
WIS-SIM 


Partially 
'Replaced by 
WIS-SIM 


Ext r a 
Because of 
WIS-SInj 


Not Affected 
by Wl^-Slm 


Yqur Role Changed 

■ Yes 1 No . • 
1 1 


^^6. Maintaining school's 
inventpry of / 

! instructional materials 

i 


0 


8 

1 


0 


92 


0 


100 




{ 17. Reporting school's 
1 progress to central 
admindstratioTi 


8 


23 


• ■ o> 


38 


15 


54 

I 


1^. Reporting student 

progress to parents ^ 


38 

1 


2 3 


0 


38 




' 77 


19* Maintaining permanent * 
school records o£ 
students' prpgress 


31 


54 


0 


0 


• 54 . 


38 


1 • 

j.20. Developing daily 
1 teaching schedules^ 

j-^ ^ — ■ 


0 

-> 


8 


« 


69 


•0 




77 , 


21. Ass^sing students in 

terms of tH'eir learning 
characteristics 


' 0 


23 


0 


• 46 


1 




22. Evaluating instructional 
programs (e.g., SAPA,^ 
WDRSD, DMP) • 


0 


- 0 ■ . 


0 


• ' 85 


U 


92 
* 


23\ " Communicating student 
information to state 
agencies i i 


, 0 

f 


■ .15 


0 

— ^ ■ 


46 - 


' 8 

• 

i 


62 
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9 

1 . ' 


.2 


3 


^ ■ 4 


5 


6 


• r 




I- 

1 - 

1 ^ 

[ ■ Task 


Completely 
Replaced by 


Partially 
Replaced by 


Extra 
Because of 


Not Affected 


-^^our Role Changed 






WI^-SIM 


WIS-SIM 


■ WIS-'SIM 


by WIS-SIM 


Yes 


No 






24. 


« 

Updating student 
performance informatign 


62 


■•23 


0 


0 


85 


8 < 


00 




25. 


Marking or scoring 
tests 


0 


15 


'0 - 


85 


15 


85 






lb, 
h 


Determining rate of 
progress of individual 
students 




54 


0. . ' 


46 

i 




8 

H 


92 






27. 


Determining students' 
readiness for uhe next 
instructional step 


0 


54 

1 

I 


0 


i 
f 
1 
\ 


i 

1 


85 




« 




i 


* 

V 


/ 

• 
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* t 

• 






. 120 


-> 












•> 
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TABLE XLIV • 
SCHOOL TASKS AFFECTED BY WIS-SIM 
ALL SCHOOL'S 
1975 - 1976 



N = 55 



1 



Task 



l.| Iccncifying individual 
student instructional 



needs 



2. Assessing student 
learning outcon-.cs 



Ccn'.plctcly 
Replaced by 
■ WIS-SIM 



25 



Partially 
Replaced by 
WIS-SIM 



44 



Extra 
Because of 
WIS-SIM 



3. Maintaining unit 
• . ^^crtomancc profiles 



35 



^ 38 



'35 



13- 



Not Tvf fected 
by mS-SIM 



20 (5.)' 



4(5 (10) 



7 (1) 



Vo'jr Role Changed 



Yes 



45 (6) 



40 (7) 



62 U) 



No 



49 



55 



35 



4. Maintaining individual * 
, profiles 



31 



5. Coroaring the status of 
students in unit to 
school, system or other 



/ 



norr.s 



40 



• 9 (3) 



20 



56 (21) 



62 (3) 



13.(18) 



33 



73 



6. Assessing CTfc attainment 
of unit goals 



38 



47 (15) 



25 (12) 



69 



7.. Assessing the attainnent 
of individual -student 
goals 

E^-f^8 — 

i 



16 



40 ' 



42 (13) 



36 (90) 



60 



131 



1 2 _3 4 5 6 • 



12 


! 

Task 


Completely 
Replaced by 
WIS-SIM. ^ 


Partially 
Replaced by 
WIS-SIM 


Extra 
Bej;ause of 

WIS-SIM 

< 


Not Affected 
by WIS-SIM' 


Your Rol 
Yes 


e Changed 

. No 


8. Formulating unit 
'goals 


5 


/ 27 


4 

• 


1— 

56 (2^)) 


^15(16) 


80 • . 


! 9.' Developing instructional* 
objectives for each 
child in the unit ^ 


4 

4 


35 


9 

*> 


' — r — 

47 C64)|^ . 

< 


22 (15) 


75 


10. Evaluating learning 

activities with respect \ 
• to unit goals 


« 

. 4 


36 


4 


49 (16) 


15 (17^, 


^^ 

82, 

^ ■ 


11. Grouping students* for 
* instructional purposes 


24 


53 


9 


9 (2) 


47 (-i-)-^ 




\ 

12. Counseling students- 
about their progress 
• and future schooling 


2 

> 


16 


4 ■ 


62 (22) 


13 (19) 


73 . 


13. Selecting appropriate 
materials, media, anci 
supplies for instruction 


0 

\ 


' ■ ■ - - y 

9 


0 ' 


80 (26) 


.5 (26) 


82 


14. Evaluating unit 
operation 




11 ' 


2 


53 (17) 


9 (?3). 


75: 

t 


15. Assessing the status of 
£ entering students 


7 


44 


5 


36 (9) • 

• 


33 (11) 


60 Ic 



1 " 2 - 3 4 5 6 - 



1 . : 

*Task 


Completely 
Replaced by 
« WIS-SIM 


Partially 
Replaced by 
WIS-SIM 


Extra 
Because of 
WIS-SIM 


Not Affected 
^ by'WIS-SIH 


Your Rol 
Yes^ \ 


e Cha^gfed 

No,- 


16. Maintaining school s 
inventory of 
instructional materials 

1 


2 


5 


0 

• 


80 (27) 


T {21) 


* ^9 • 


1 

17. Reporting school's 
progress to central 
administration • 


11 


20 

> 


4 


40 (11) 


12 '(14) _ 

L 


55 


18. Reporting! studerft 

progress to parents 

t 


9 


45 


2 


. 33 (7) 


36 (9) 




19. Maintaining permanent ^ 
school records of 
students' progress 


16 


40 


9 

* » * 


. ■ 25 (6) 


49 (4) 


45 


20. Developing daily 

teaching schedules 


0 


11 


5 


73 (23) 


5 (21) 


82 


21. Assessing studerits in 

terms of their learning / 
characteristics 

. . — • 


2 

> 


11 


2 . 


73 (24)- 


5 (24) 


78 

"I 


22. Evaluating instructional 
programs (e.g., SAPA, 
VTDRSD, DMP) 


2 


. 18 


t 

7 


' 55 (19) » 


11 (20) 


"76 


23. C6mmunicating student 
information to state 
agencie^ 


2 


0 

16 




53 (18) . 


9 (22) 


71- . 



v.. 



■ — ^ 

Task 


Completely 
Replaced^by 
WIS-SIM 


Partially 
Replaced by 
WIS-SIM 


Extra 
because of 
WIS-SIM 


Not Affected 
by WIS-SIM 


Your Role Changed 


Yes ^ 


•No 


24, Updating student 

performance information 


22 




15 


11 (4) 


62 (1) 


31 


25. Mari^rtg or scoring 
4rests 


2 




5 


78 (25) 


11 (21) 


80 


26. Determining rate of 

progress of individual 
students 

* 


13 


35 


A 


42 (13) 

• 


24 (13) 


€7 


. 27> Determining students' 
readiness for tbe next 
^instructional step 

" 


15 




— , 

> 


35 (8) 


38 (8) 


58^ 



00 
00 




137 



89 



1 ' 
2 
3 
4 
5 
6 
7.5 
7.5 
9 
10 
11 
12.5 
12.5 
14 
15 
16 
17.5 
17.5 
19 

20_ , 
21.5 
21.5 

23 

24 
25.5' 
25.5 

27 



TABLE XLV 

RANK ORDER OF TASKS AND ROLES AFFECTED BY ViS-SIM 1975-76 



















M 












CO 

1 




a; 
> 




c 






?^ 






•H 




M 

:2 




ce 




-o 


w 








w 


Q) 


o 








M 








a 


GO 


C 






C 




c 










14-1 




u 


o 






0 


ch 


U) 


u 




CO 


u 




X 


0) 


(U 






cu 


w 












to 








U 


0 


H 


o 




H 


a 


u 



5 
2 
2 
6 
2 
8 

9.5 

9.5 

11 

13 
7 

12 
16.5 
16.5 
14.5 
14.5 
2^.5 
18.5 

20.5 
22.5 
18. 5r^ 

25 

25 
20.5 

25 

- 27 



Grouping Students' Instructional Purposes 
Maintaining IPP 
Maintaining UPP 

Identifying Individual Student Instructional Needs 
Updating Student Performance Information 

Determining Students' Readiness for the Next Instructional Step 
Maintaining Permartept School Records of Students' Progress 
Assessing the Attainment of Individual Student (Joals 
Reporting Student Progress to Parents 

Assessing the Status of Entering Students ^ 
Determining Rate of Progress of Individual Students 
Assessing Student Learning Outcomes 
Assessing- the Attainment of Unit Goals 
Formulating Unit Goals 

Evaluating Learning Activities With Respect to l)nit Goals 
Developing Instructional Objectives for Each Child in the Unit 
Reporting School's Progress to Central Administration 
Evaluating Unit Operations 

CompHj^ yfie Status of Students in Unit ta School, System, 
or Other^No/ms 

Evaluating Instructional Programs 

Communicating Student Information to State Agencies 
Counseling Students About Their Progress and Future Schooling 
Assessing Students in Terms of Their Learning Characteristics 
Developing Daily Teaching Schedules 
Marking or Scoring Tests ^ . , 

Selecting Appropriate Materials, Media, and Supplies for ^ J 
'Instruction / 
Maint^ainii^ School's Inventory of Instructiohal Materials 
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S 
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7., Assessing attainment of individual student goals (56). 

11. Grouping students for instructional purposes (77). 
.15. Ass essi ng status of entering s^iudents (51). 

18. Reporting student progress to parents (5A) . 

19. Maintaining permanent' school records of students' progress 
(56). 

2^. Updating student perf ormance^l^iformation (66). 

' 26. Determining rate of progress of individual students (48). 
. \ ^ . ' 

27. Determiriing students* readiness for the next instructional 
step '(^9)./ ' » 

V* * 

X 

Tasks Anticipated Not to be Substantially Affect>6d by WIS-SIM 

5. Comparing the status of students in unit to school, systen\, 
or other norms (56). ' • ' 

8. Formulating unit goals (^6), ^ 

9. Developing instructional objectives for each , child i'n'lhe 
unit (47), 

10. Evaluating learning activities with respect to Unit eoals 

12. Counseling students abouf their progress and future schobline 
*(62). 

13. Selecting appropriate materials/ media, and supplies for 
instruction (80). 

' 14. Evaluating unit operations ('53),' 

16. Maintaining school's inventory of instructional materials 
(80). , • . . 

* 

17; Reporting school's progress to central administration (40), 

20. " Developing daily teaching schedules (73).' 

21. Assessing students in terms of their learning characteristics 
"(73).^^ ^, ^ > 

» "22. Evaluating instructional programs (58), ,j 
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23. Communicating student information to state , agencies (53)^ 
25. Marking or scoring tests (78). 

A design goat was that the system would not create extra ' 
tasks for teachers. The low percentage of teachers responding that 
tasks were extra because of WIS-SIM suggests that this design goal 
was achieved. An additional observation may be made concerning the- 
relationship between extent; of system use and the number of tasks 
affected by WIS-SIM. High usage schools report'more expected^ tasks 
as being replaced by WIS-SIM than do low. usage schools and, conversely, 
high usage schools report- fewer tasks as being extra because of 
WIS-SIM. ^ 



Analysis of the 1976-77 Survey 

Tables summarizing school tasks perceived to be affected by' 
McFarland teachers and Thoreau teachers are summarized in* Tables 
XLIX and L. A composite of these summaries is presented in Table LI. 
As indicated in column 3 of Table LI, only one task, "Comparing t^e 
status of students in unit to school, system, or other norm", task 
3, was considered by 10 percent or more of the respondents from the 
user schools as being ext-ra because of WIS-SIM. This response is 
not considered significant, as it represents only one of the six 
respondents from Henry David Thoreau. A total of nine of the 27 
tasks were considered as new in the cumulative survey, but these 
tasks reflect the response from only one of the total 21 respondents. 
Since McFarland is in its third consecutive year of WIS-SIM usage 
and Thorea^ is in its second consecutive year of usage, it is not 
surprising that only a few tasks were considered extra, by-tujrly a 
few of the staff members surveyed. 

Th6se feasts considered replaced either completely or partially 
by WIS-SIM are addressed 'in .columns 1 and 2 of Tables XLVI thXQugtr 
SLVIII. Column 4 refers to those tasks not affected by /usage of< 
WIS-SIM. All of the 27 tasks in the 1977 survey were considered -by 
some percentage of the respondents as being<%ither completely or 
partially replaced by WIS-SIM. Likewise,- some percentage pf the 
respondents considered all -27 task's as not being atfected by WIS-SIM. 
In both cases, however, the response may reflect the perception of 
only one individual. - The tasks perceived by, more than half of the 
respondents as being completely or partially replaced by WIS-SIM are: 

1. Identifying individual student instructional needs (1). 

2. Assessing student learning outcomes (2). 

, ' *• 

3. Maintainin2,unit performance profiles (3). 

4. Maintaining individfual profiles (4). ' ^ 

5. Assessing attainment of unit goals (6). 
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TABLE XLVI 

SCHOOL TASKS ^FfIiCTED BY WIS->SIM 

MCFARLAND SCHOOLS 
Percentage Responses 

1976-1977 
1 2 . -3 



N = 15 



6 ^ 





Completely 
Replaced by 

t ? T c C T M 


Partially 
Replaced by 


-^xtra 
Because of 
w io— o in 


Not AfTected 

Ksf TJT C CTf/ 

oy Wio*"5irl 


Your Role 
^ Yos 


2 Chan?,ed 
, «%o 


1. Identifying indiyidual 
student instructional 
needs 


.0 


ioo 


0 


0 


67 


33 


* * 

( 

2. Assessing student 
learning outcomes 
> 


, 0. 


53 


7 


40 


40 I 


60 _ 


3. Maintaining unit " ^ 

performance profiles 

< 


73 


20 


■ 7 


0 


93 


7 . : 


4. Maintaining individual 
profiles. 


47 , 


53. 


p ' 




87 


13 ' 


5. Comparing* ?he status 'of 
students in unit to , 
.school, system or other 
norms 


13 


40 


*■ , 7' 


40 


. 53 


■ A- 


, 6. Assessing- thti attainment 
of unit goals * 


\ 

7 


67 


' 7 


20 


60 


40 . - 


1 J» J Assessing the^ attainment 
^ ^ of individual' student 
O Boals 


0 


67 ' 


* 

Q 


33 


47 


53 







> * * 


1 


r 


3 


4 


5' 


6 • . 








Completely 
Replaced by 


\parcially 
. Replaced by 


Extra 
Because of 


Not Affected 


Your Role Changed 








Task* 


WIS-SIM 


/ WIS-SIM ^ 


WIS-SIM 


^ by WIS-SIM 


Yes 


. No 






8. 


Fornulacing unit ^ 

goals / 


. 

13 

C 


• 

47 


7 


33 

* 




47 






9. 


Developing instructional 
objoctli^es for each 
child in th6 unit 


0 


53 


0 


47 


40 


60 


\ 




10. 


Evaluating learning 
activities with respect' / 
to unit goals 


0 


60 


7 


• 

■ 33 ' 


40 


60 • 


\ 




11. 


Grouping students for 
instructional purposes 


9 


< 

100 


0 


0 


60- 


40 






12. 


Counseling students 
about their progress 
and future schooling 


d • 


40 


0 


53 • 


20 


73 






13« 


Selecting" appropriate 
materials, inc(^ia, and 
sjupplies for instruction 


0 . 


7 


0 


93 


0 


1 r\r\ 
lUU 






14. 


Evaluating unit 
operation 


• • 

0 


60 ■ 


' r 

0- 


40 




> 

60 






15. 


Assessing the status of 
, entering students 


6 


60 


7 


27 


33 


60 
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1-43 


• 


-a 




< 
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Task 


Completely 
Replaced by 
WIS-SIM 


Partially 
Replaced byi 
WIS-SIM \ 


Extra 
Because of 
■ WIS-SIM 


' Hot Affected 
by WIS-SIM 


Your'Rol 
Yes 


e Changed 
No 


16. Maintaining school s 
inventory of 
instructional materials 


— — — — 

0 


•7 


0 


87 


0 


^. 

93 


* 

17. Rep(^rting school's 
progress to central 
adminis^at ion ^ 


\ y 

0 

a 


'40 




r 

33 


27 


47 


18. Reporting student 

progress to , parents 


13 , 


60 


7 


20 


67 

% 


33 


19. - Maifritaining permanent 
school records of 
'students' progress . 


33 


67 


0 






■33 


20. Developing daily 

teaching^ scffedules ^^—^"'^ \ 

^ \ 


> 0 / 


33 


b 


67. 


.27 - 


60 


' ^ — V- ^ 

21. Assessing studentSvin ^ ^ 
terms o£ their li^arning 
character isfi^^^: > , . 


Ik 

0 " 


- 20 


0 


73. 


7 


80 


22.. Evaluating instructional; ^ ' 
programs (e.g., SAPA,\"* ^ 
.WDRSD, DM?) • ft. 

• ' ' *■ 




, 47 




27 




33 


P 

23. Cominunica.t ing student ^ 
i r information to state 
. agencies 

\ ^ — 


' o , 

0 0.. '-I- 

.» ^' 


7 . 


' •■ 0 


'33 


7 


33 
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^ Task 


Completely 
Replaced by 
WIS-SIM 


Partially 
Replaced by 
. WIS-SIM 


Extra 
" Because of 
WIS'-SIM 


.-"i^ot^f fecced / 
. by WIS-SIM 


' Your Rol 
Yes ' 


e Changed 

No - 


24, ' Updating student 

performance information 


33 


53 


0 


• 

20 • 


67 


33 . 


25. Marking or scoring 

tests ^ 


7 


27 


* » 

0 


67 


33 ■ 


67 


26. Determining rate of 

progress of individual 
students 

r 


27 


47 


0 


27 


/ 67 


. 33 


27, Determining students' 
readiness for the next 
instructional step 


20 


< - 

J3L 


7 


7 


'73? 


2 7^ 



vO 



ERIC 



147 



148 



TABLE XliVII • 
SCHOOL TASKS AFFECTED BY WIS-SIM 
HENRY DAVID THOREAU 
Percentafie 'Responses 

1976-1977 



N = 6 



ON 



— ' 1 

Task. 


Completely 
Replaced by 
WIS-SIM ' 


Partially 
Replaced by 
WIS-SIM 


Extra- . 
Because of 
* . WIS-SIM 


Not "Affected 
by WIS-SIM 


Your Role Changed , 


Yes 


No ' 


• 1. Identifying individual 
V student instructional 
needs . . , 


17 


D / 


u 




50 


50 


2.^ Assessing itudont 
learning outcomes 


0 


67 


0 


33 


17 V. 


- 83 


3. Maintaining unit 

performance profiles 


- > 

33 " 


50 


0 


17 


33 


. 6.7. 


4. ^ Maintaining indivi,duaX 
profiles 


33 


50 


0 


17 


4 


67 . 


5. Ccnpnring th'e status of * . 
Tcudents in unit to 
school, system or o~ther 
^ norms 


0 


33 . 


17'. , 


50 


0 


100 


6. Assessing the attainment 
of. unit goals 


0 


' 50 


0 


3-3 


0 


'83- 
X 


^ 7» Assessirig the attainment * 
'1^ of individual student 
^ goals ' - • . 


17 


33 


I 

0 


67 


0 ' 


4«A • 

83 

' 





9i» . " . • 


1 


* 

2 


. 3 ■ 




5 


6 






- - --- . _ 


















Completely 
Replaced by 
WIS-SIM 


Partially 
Replaced by 
WIS-SIM 


Extra 
Because of 


Not Affected 


Your Role Changed 






Task • 


WIS-SIM 


by WIS-SIM 


Yes 


No 






8. Formulating unit 
. goals- 


0 


33 


0 


> 

67 


0 


67 ' 






...9*.,. Develaplng instructional . - . 

objectives for each 
child in the unit • 




• 




• 












33 


0 


67 

V 


0 


67 






10. Evaluating learning 

activities with respect 
to unit goals 




17 


■ 0 


67 


0 


- 

83 


• 




11. Grouping students for 
ins true t-ional purposes 

f 


17 


67 


0 


1:7- 


17 


83' 






J ■ — 1 ' 

b 

12. Counseling students 
about their progress 
and W¥tire schooling 


17 


17- 


0 


&7 ^ 


17 


83 






13. Selecting apQ^priate 
materials, media, and 
supplies for instruction 


0 


17 


0 


83 


17 


67 






14. Evaluating unit ^ 
operation 


It 

0 


33. 


•{)■ - 


50 


0 


8J 






15. Assess*ing the scatus of 
entering students 


0 


17 


' 0 


67 


1 7 

X / 


67 

» 


















* 151- 

ERJC - * 


- 










152' 

















12 3 A 5 6 



Ta§k 


Completely 
Replaced by 
WIS-SIM 


Partially 
Replaced by 
WIS-SIM 


" Excra , 
Because of 
WIS-SIM 


Not Affected 
by 'WIS-SIM 


Your Role Chanj;iBd 




Yes 


No 


16. Maintaining school's 
inventory of 
instructional materials 


0 


0 


0 


83 


0 




83 


00 

54 


l7. Reporting school's 
progress to central 
adninistration 


0 


.33 


■ 0 


50 


17 


- 67 


18. Reporting student 

progress to pa^rents 


b 


50 


0 


* « 

33 


17 


67 


19. Maintaining permanent 
school records of 
students* progress - , ^ ^ 


0 


i 

,"50 


^ 0 


\ 
33 


- 

0 


83 


20. Developing daily 

teaching schedules ^ 


0 


0 


0 


83' 

t 


/ 


83 


' / 

21. Assessing students in 
' terms of their learning 
characteristics 


^ 

0 a 


0 


0 


* 

83 


0 


83 


22. Evaluating instructional 
programs (e.g., SAPA, 
WDRSD, DM?) 


0 

#° 


17 


0 


67 


0 , 


,83 


23. Communicating student 
information to state 
f-*^'^ agencies ^ 


. * 0 


0 


0 


63 


0 


i 

67 . 
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Task 


Completely 
Replaced by 
WIS-SIM 


Partially 
. Replaced by 
WIS-SIM. 


Extra 
Becau'se of 
-WIS-SIM 


Not Affected 
by WIS-SIM 


Your Rol 
Yes 


e Changed 
No 


24, Updating student 

pef'fornance information 


0 


67 

* 


0 


17 


17 


67 


.,.25^.....>Jax:kij]Lg.J3r.,scarin&,.. — 

tests 


0 


17 


" 0 


' ' 67 ' 


' yT"' 

/ 


67 


.26. DoMermining rate of 

progress of individual 
students 


0' 


17 


0 


r 

50 

. ^ 


17 


83 


27. Deternining students' 
readiness for the next 
instructional step 


0 


0 


0 


67 


17 


83 
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15a 




Task" 



l." Identifying individual 
st-udent instructional 
needs 



2. Assessing student 
learning outcomes 



3. Maintaining unit 

pcrforqance profiles 



4. Maintaining individual 
profiles 



tAble xlviii 
school tasks affected by wis-sim 
all schools 

Percentage Responses 

1976-19.77 
1 . 2 3 



N = 21 



Completely 
Replaced by 
WIS-SIM 



Partially 
Replaced by 
WIS-SIM 



90 



SI 



52 



^ 43 



Extra' 
Because of 
WIS-SIM 



57 



29 



52 



o 



Not Affected ' 
by WIS-5IM 



38 



Your Role Changed 



Yes 



62 



33 



76 



71 



No 



38 



67 



24 



29 



5. Conparing the status of 
students in unit to 
schoo.l, system or other 
norms . 



6. Assessing the attainment 
of unit goals 



7; ■ Assessing the attainment 
, J of individual student 
5r7 goals 

FRir 



10 



38 



'JO . 




43 



62 



57 



24 



43 



38 



43 . 



33 



62 



52 



lire 



62 



< 



Task 



Completely 
Replaced by 
WIS-SIM 



Partially 
Replaced by 
, WIS-SIM 



Extra^ 
Because of 
WIS-SIM 



Not Affebted 
by WIS-StM 



-6 



Your Role Chanced 



Yes 



lange 



Formulating unit 
goals 



'4- 



Developing instructional 
objectives for each 
child in the unit 



10 



A3 



A3 



38 



A8 



52 



29 



52 



62 



10. Evaluating learning' 
- \ activities with respect 
to unit goals 



11. Group ing^students for 

instructional purposes , 



12. Counseling students 
about their progress 
and future schooling 



'AS 



90 



33 



A3 



57 



29 



A8 



19 



67 



52 ' 



13. Selecting appropriate 

materials , ifiedia, and \ 
supplies for instruction 



14. Evaluating, unit 
operation 



15. Assessing the status of 
entering students 



t 



52 



48 



90 



43 



38 



29 



90 



.67 



29 



62 
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Task 



16, 'Maintaining school's 
'inventory of 
•^instruct ional m^erials 



17. Reporting school's * 
progress to central 
administrat ion 



Completely 
Replaced by 
WIS-SIM 



2 

Partially 
Replaced by 
WIS-SIM 



38 



Extra 
Because of 
^ WIS-SIM 



Not Affected, 
by WIS-SIM 



86 



38 



Your Role Changed 



Yes 



24 



No 



52 



18.- Report ipgl^CudenC 

progress to parents 



10 



57 



24^. 



52 



43 



19.. Maintaining permanentt 
, school fecords of 
students' progress 



4,. 



24 



62 



I'O 



48 



.43 



20. Developing daily 

teaching schedules 



■ \ 



0 ■ 



24 



71 



19 



67 



21. Assessing students in 

terms of their learning 
characteristics 

A 



14 



76 



81 



22. Evaluating, instructional 
programs (e.g., SAPA, 
WDRSD, DMP) \ 



10 



38 



38 



# . . 

23. Communicating student 
informatioi\ to state* 
04- agencies 



33 



48 



\ 

;0 ' 



\ 43 



ERIC 
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If a. 



IJ 2 3 4 '5 .6 



Task 


Completely 
Replaced by 
WIS-SIM 


Part lally 
Replaced by. 
WIS-SIM, 


Extra 
Because of 
WIS-Si'M 


Not Affected 
. by WIS-SIM 


Your Rol 
Yes 


e Changed 
No - 


' 24, Updating student ' 

performance information < ' 


U 


57 


0- 




52 


43 


25, Marking or scoring 
tests 


5 


24 


0 ■ 


67 ■ > 


< 

29 


67 


26, Determitiing rate of 

progress of indjvidual 
students 




38 


0 


33 


52 


48 


n. Determining students' 

readiness for the next/ * 
instructional step 


14 


48 


^5 


24 


', ■ 57 


43 



t 



ERIC 



163 



o 



164 



104 



6. 
7. 



Grouping students for instructional purposes (11) 



Evaluating unit operations (14) . 

8.. Reporting student progress to parents (18). * 

,9. Maintaining, permaneut reco^dg^f students* progress (19), 

10. Updating student performance information (24). 

' The tasks perceived by mor.e than half, of the respondents as, 
not being affected by th^. use of WIS-SIM are: * ' 



Developing instructicmal objectives for »each chi^-ld'in the 
unit (9). . / / V ' ' 



2. Counselirig students about their progress and future schooling 
(12). ^ 

3. Selecting appropriate materials, media, and supplies for 
instruction (13) . 

4. Maintaining school inventory of instructional materials 
(16). 

5. Developing daily teaching schedules (20). * 

6. Assessing students in terms of their learning characteristics 
(21). 

7. ' Marking or scoring tests •(25). 

As in' the 1976 survey, proportionately^ few respondents reportpdv 
the perception that usage of WIS^SlM had 'completely replaced a m«rnual 
task or procedure (column 1). Also as ^in 1976, two tasks were ^ 
considered ,by 25 percent or more of the respondent^ as completely 
replaced--maintaining unit performance profiles and maintaining 
individual performance profiles.' Of ' interest is the^fact that no^ 
respondent reported task 2, assessing student outcomes, as completely 
replaced by WIS-SIM (and this- would appear to be a logical response) 
while in 1976, there were some responds' to indicate that perce{5^t'ion. 
This may be interpreted as a sign of^ more complete^underjttanding 
of WIS-SIM as well as its integration into -the overall instructional- 
system. All of the tasks reported above" as being affected by. WIS-SIM, 
excent^or evaluating unit operation, were expected to do so, and all 
thosd reported by 50 percent of ^the respondents as not being affected" 
by wiS-SrfT were those expected.' 

The pprception of role chang^ or responsibility cliduge as a • 
result of WTS/-SIM appeaijs to closely parallel the perception of 
tasks affected by WISrSIM. Table^XLIX, column 1, provides a rank ' 
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TAIJl.i; XL IX 

RANK ORDER OF TASKS AJJD ROLES AFFECTED BY 
V ^ WIS-SIM 1976-77 * ' 



27 



Identifying Individual Student Instructional Needs ^ 
Maintaining IPP v. ' 

Grouping Students for Instructional Purposes ' ' / 

Maintaining Permanent School Records of Students ' Progress 
Updating Student Performance I^nfor^mation 
Maintaining UPP 

Assessing the Attainment of Unit Goals 
Reporting Student 'Progress to Parents ' ^ 
Assessing the^tainment of Individual Student Goals « 
•Determining Students' Readiness for the Next Instructional Step 
Determining Rate of Ptogress of Individual Students ' ' 
Evaluating Unit Operations 

Comparing the Status .of Student^ in Unit to ^hool^ System 
or ^ther ^forms ' - \ ^ j 

Fo'nnulating Unit Goals ) * • 

Developing InstructionaKQbjectyives for Each Child in the 
Unit^ * ^\/ 

Evaluating Learning Activities With Respect to Unit Goals 

As^ess(lng the Statu^xt/f.; Entering Studenf;^ 

Evaluating Instructio'nal .Programs/ ' y"^^^ 

Assessing <^tudent ^L^rning OiitcomesV* . r . > 

Courtsellihg Students "About Their Prog>ess and Future Schooling 
Repo^ting^Sehool'^ .Progress to Qeiftral Administration - 
Marking or Scoring Te'^fcs . " ; ' 

Developing Daily Teaching Schedules ^ ' ^ ' 

Assessing Students in Terms of Their Learning Characteristics 
CommunicatiTig, Studtnt^In'formation to, State Agencies 
Selecting. Apprbprlate Materials, Media, and Supplies fo^ 

Instrtiction . ^ • ' * 

Maintaining S'chool's Inventory of Instructional Materials 
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^ order listing of the tasks considered by. the respondents as most 

affected by WIS-SIM. Column, 2 provides a rank .ordering of the tasks 
^ in which role changes were perceived by the respondents. The 

• Spearman Rank Correlation Coefficient is calculated to be .92, 
indicating that agreement between the two rankings is quite high. 
This correlation is significant* beyond the .01 level. * • 

The effect of WIS-SIM use o'i> school tasks and 6n user roles as 
perceived by teachers appears to be significant / according to the 
re&ults of the 1977. survey. The effects A-e more obvious in the 
McFarland schools as tneir' usage is considerably ^higher than in 
Thoreau, and the McFarland system operates in three* curricular areas. 
^ The effects are found in the areas anticipated. 






•IV 



SYSTEM EFFECTS 



In this chapters. t:he answers to the following questions are 



sought: VThat results 
and are the objectives of 
tion analyzed in this 
use, student achievement. 



achieved from the utilization of WIS-SIM*, 
he system being accomplished? The l^aforma- 
er includes a survey of teacher time 
ystem costs, changes in school operations 



and staff attitudes tow/frd WIS-SIM.- 



TIME USAGE SURVEY 



One of the design objectives of the Computer Applications in 
IGE project is to provide a management information' system that/ 
enhances the educational process through increased ' efficient use of 
time. It is assumed tltat efficient teacher time usa^e will be 
reflected in improved instruction and learning/ 




In order to evaluate the changes in time usage, the user schools 
participated in a survey designed to determine what effect WIS-SIM 
is having *on the proport ion** of time school personnel spend in 
planning, instructing, and performing clerical^ tasks. 

School year 1975-76 time usage data were colleet;ed from all six 
user schools dufing April-Ma,y 1976. AIL administrators, teachers, 

"and aides who were using the computer service's of WIS-SIM were'asked 
to complete a time usage' form that was the same as that used in the 
earlier surveys. The data. were collected over a two-;week period; 
the principal of each school selected half^of the staff to complete., 
the ioVm+ the first^week and the remainder of the staff *the following 
week. ^Principals were asked to use fheir discretion as to which two 
weeks in April and 'early May to^ select^^so as to ensure thdt the 

^particular weeks chosen would be "normal" school times, i.e., times 
that' would produce information representative of^gener^l school 
activities ana give, a fair indication of the .time spent by the stafT 



on planning tpsks, instructional tasks, and clerical tasks. 

School year 1976-77 time usage data were collected from Conrad 
Elvehjem and McFarland Elementary during^November-December, 1976. 
Those staff members using WIS-SIM were asked to complete a time usage 
fgrm idfentical that used in both 1974 and 1975. The data were 
* collected during the weeks of November 14^20, and November 28-December 
.4, 1976. These ^time periods were c\ 
of, normal sctiool times and coinco 
^^J^ime us^ge 



^ata period of . the initJ 



i^en because they were repre'sentat ive 
ed' (within a few'days). with the 
1 comparisoji in 1974. 
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Two previous surveys had been conducted in NovembeiVDeceinber 1974 
and April-May 1975 at the McFarland Schools (McFarland Elementary 
and Conrad Elvehjem) and at the Waukesha Schools (Barstow and 
Northview). The data collected in these previous surveys will be 
compared to the data collected in the April-May 1976 survey. The 
Steven^ Point Schools (Jackson and Plover-Whiting), and the Milwaukee 
School (Henry David Thoreau) were not user Schools in 197A, and no 
data is presented for these schools. 

Two points should be considered concerning the respondents to 
the study. First, the respondents at the two McFarland schools do 
not include either the CMI project director or the terminal operator,' 
both of whom are full-time staff members engaged exclusively in the 
WIS-SIM implementation. Although mean and aggregate ' usage data for 
these schools will be deflated— and this^ is important when making 
inter-school comparisons — they are not a problem in making intra- 
school comparisons "over time bep^use these two individuals have been ^ 
constantly omitteci from each of the surveys. 

Second, the Jackson ' Elementary School did not submit separate 
survey torms for individual teachers, aides, and administrators. 
Rather,, the school presented a single form, allegedly representative 
of^ the time allocations of all staff. Therefore, the only information., 
available from tbe"" Jackson school i^ that relating to the proportions . 
9bf time spent in planning, instructional, and clerical activities 
by all staff. • ' , 

For each of the categories: teache^^^f^des, and administrat 
■^the mean hours per week per respondent, and the percentage of time 
spent in each of the areas of planning, instructional, and clerical 
task^ were collected. These data w^re cbllected from four user 
schools and a<e displayed in Tables L through- LV. • 

Changes in the' amounts and the proportions of time. spent on . 
plannijig,^ instruction, aj\d clerical tasks by school staff can, of 
course, be influenced by factors other than the introductions of 
^management information system such as WIS-SIM. Most obviously, 
policy changes as reflected in the hiring of additional clerical 
help or in a reallocation of duties ^could have significant effects '^'^''^^ 
on time allocations as well. In an 'attempt to control for these 
and'^other potential influenced, principals of thp four schools invoLv-ed 
when the 1975 time usage surveys were taken were asked to indicate 
whether there had been any attempts to increase or decrease the 
percentages of time spent ort planning, instructional, and clerical 
tasks by -administrators, teachers, and aides ^ince the last survey. 
None of the principals indicated that any such attempts had been 
made.' Nevertheless, a school ' staff irtg iprofile for each school i s - 
provided in Table L. This profile , which includes number of students 
and staff of various categories in each of the^schoc^l years 1974-75, 
197*5-76; and 1976-77 , should be referred to when interpreting the 
results of the' survey. .( 
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Despite the hazardous task ascribing any change in the times 
spant by various staff on planning, instructional, and clerical • 
activities, it seems that by requesting principals to select normal 
school times for the survey, by attempting to identify deliberate 
policy changes, and by taking into account ^different student-staff 
profiles from year to year, we will ensure a more accurate assessment. 
The reliability and validity of teacher ^elf-reportings remjrins 
c^ues^onable. This difficulty specifically concerns the distinctions 
between planning, instructional, and clerical tasks; such distinctions 
may not always be clear. 

^ A basic difficulty concerns shifts in time spent on the various 

tasks. ^ It may be the case that an organizational innpvation may 
reduce* time spent on some clerical tasks, but that this slack- time 
may be filled by staff' substituting other clerical tasks not 
previously' attempted. The very basic question of quality of worlc is 
not examined in this survey report, but it is likely that changes 
in quality of work ars well as quantity of performance can occur. 
It is often the case that changes over time in' the quantity of work 
done is substituted tor by changes in the quality of work performed, 
and vice versa. It is recommended that one be mindful of these 
difficulties when interpreting the information in Tables LIII through 
LVIII. , • 

4 

Implicit in the WIS-SIM objective of incre'asihg time-usage 
efficiency is the reduction of time required for clerical duties. 
Tables LI through LV assess the extent to which this aim is being 
met. Tables LIV and LV provide a comparison of time usage, including- 
percent of time spent on the Jasks of planning^ instruction, and 
clerical, over^four time periods at the two McFarland schools. The 
percentage of time spent qn clerical tasks decreased from lp.5 . 
percent in 1974* to 1A,3 percent in the same 1976 time period at , ^ 
Conrad Elvehjem. A decrease from 11.0 to 8.5 percent was observecl 
at McFarland Elementary during this time period. Tables' LIII and LIV 
reflect similar decreases in the proporti9n of time sp^t on clerical 
duties at -Barstqw and Northview. A corresponding ificrlfese in 
instriictional time may also be observed intthe^time usage data of 
these/two schools. , * - -* * . \ 

J * * ' ' " ^ ^ ' \ 

A composite of the -time usage data .from McFarland, Conrad 

Elvehjem,,. Bars tow, and Northview is ^included in Table LV. A • ' 

decrease of 3.3 percent of time for clerical duties, or an average of 

2.2 hours per week, is indicated. * - 

•Analysis' of the time usage data revealed ah obstacle that had ^ 
been foreseen, but underestimated: the .reliability ' of self-reporting 
techniques. The variability associated with/the raw dat^ created some 
concern about the overall 'accuracy ofc the data. The variability X ' ' 
also made' a statistical test invblving the equality of means* of the 
respective years not rejectable at the .05 level. NeyertKTless , it 
appears the trend is toward' increas'ing time usage efficiency. The 
data for the McFarland schools are given below. 

' I ' 



TABLE. L 

STAFFING PROFILES BY SCHOOL IN TIME USAGE SJUDIES 




7/7rHROU(fH 1977 





McFarland 


Conrad Elveh.iem 


Barstow 


Nortfiview 




•75 


•76 


•77 


. ^75 


•76 


•77 


'75 


•76 


•75 '76" 


Number of 
stud^ts 


371 


379 


* 

.403 


1 315 


321 


342 


177 


136 





« 

Number of 
Teachers 


12 


12 


13 


14 


14 


12 


6 


r 
<> 


14 14 


Number of- 
Aides 


3 


r 

•3 


, 4 


2 


2 


o * 

3 


4 


k 


' '8 7 


Number ort ' 
Aides Using 
Computers 


.5 


, .5 


.5 


■ .5 


.5 


.5 


1 


1 


1 3 


Number of 
School 

Administrators 


• 1 


#. 

1 


e 

1 . 


1 


.5 


1 


1 


1 


- V ' 
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TABLE LI 
TIME USAGE DATA ELVEHJEM 



Novemb3r-De(;ember 1974 April-May 1975 



„ Position 


MeanViours/ 

Week Per ^ 
Respondent 


9 

Time 


Mean Hours/ 

Week Per 
Respondent 


%. 
Time 


,Mean. Hours/ 
Wefeic Per 
Respondent 


i 

#> 

% 

Time 


T 

Mean Hours/ 
Week Per 
Respondent 


% 

Time 


'teacher 

Planning 

Instructional 

Clerical 


15.3 • 

24^ 52 ^ 
. 7 . 29 


32.5 
52.0 


17.4 
23.0 • 
8.0 


35. A 
A6.16 
17.8 


16.3 • 
23.1 
6.0 


36.0 
51.0 
13.0 


J.4. oO 
23.65 
6.39- 


33.0 
52.7 
14.3 


All Tasks 


47.11 


100.0 


' K 
49.2 




^5.3 ^^=^^0.0 


44.84 


100.0 










'table lit 




t 












TIME USAGE DATA MCFARLAND . 










November-Decembfer 1974 


Aprll-Majc- 




April-May 


1976 


November-December 


1976 


Position 


Mean Hours/ 
' Week Per 
Respondent 


% 

^ime 


Mean Hours/ 
Week Per 
Respondent 


% 

Time 


Mean Hburs/ 

Week Per 
Respondent 


% 

Time 


Mean Hours/^ - 

Week Per 
Respondent 


% 

Time 


TEACHER 
" Planning * 
Instructional 
Clerical 


14.90 
24.42 
7.20 


32.0 
52.5 
' 11,0 


14.0 ^ 
26. i 
3.1 ^ 


* *- 

- 32.4 
60. A 
7.2 

L. 


16.0 
•22.0' 
3.6^. 


- 38.4 
52.8 
8.8 


ia.36 

22.25 • , 
3.78 


41.4 
8.5^ 


All Tasks 


46.52 


100.6 


43.3 


100.0 


41.6 


100.0 


44.39 ' ' 


100.6 

/ 



17-2. 



173 



112 



TABLE LI II 
TIME USAGE DATA BARSTOW 



November-December ]97A April-Nay 1975 ^ ^ April-May 1976 


Position 


<• 

Mean Hours/ 
Week Per % 
Respondent Time 


Mean Hoivfs/^ 

Week I'cr % 
Respondent Time 


\ 

M^ari Hours/ 
Week Per Z 
Respondent ^Time 


TEACHER 

Planning 

Instructional 

Clerical 


15. A ' 36.3 
23.6 55. A 
3.9 8.6 


14.6 . 29-8 
29.8 60.8 
4.6 • .9.4. 


13.4 33.0 
• 24.4 ' 60.2 
2.75 6.8 


All Tasks 


A4.9 100.0 


49.0 100.0 


40.55 . ■ 100.0 - 


. • X . • • 

' ; ^ • ^TABLE LlV ^ > ' 
^'^^^'^ . 0 ^ TIME USAGE D^TA NORTHVIEW 

November- DL^cjHmber J 97^4 . April -May ]975 April-May 1976. 


Position 


Mean Hours/ ' 

Week Per % 
Respondent . Time 


J'lean Hours/ * ' s 
' Week Per % 
■Respondent Time 


Mean Hours/ 
\ Week Per %^ 
R,bspond£nt ' Time 


♦'^ 

TEACHER. 
P]annjnj3 
i Instruct ional - 
/ Clerical ' 


13.5 32.2 
22.9^ . 53.8 
6.0 U.O 


14.6 31.-7 
25.6 55.9 
• 5.7 12.4 


14.4 33.3 ' 
23.8 55.1 ' 

5.0 1L.6 - 

« ■ 


All Tasks 


'42.^ 100.0 


A5.'9, 100.0 


'43.2 • 100.0 

4 
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TABLE LV 

A 

\ 

TIME, USAGE DATA— MC FAR LAND, CONRAD ELVEHJEM, BARSTOW, 



' NORTHVIEW, COMBINED . 
^Noveniber<;Deccmbor 197A AprilV^ay 1975 ^April-Mciy 1976 



V 

Position 


✓ 

Mo.an Hours/ 

Week Per % 
RcspondciU Time 


Mean Hours/ 

Week Per % 
Respondent Time 


Mean Hours/ 

Week Per % 
Respondent i^Jfine 


TEACHER 
Planning 
Instructional 
Clcriccil 


> 

11.5 26.8 
2A.A 54.8 
8.4 18. 4» 


12.5 "29.4 
23.5 ' 55.5 
6.4 15.1 


10.9 55.0 
26.1 59.9 
6.6 15.1 


All Ta.sks 


44.3 100.0 


* 42.4 100.0 


43.6 100.0 







i 

s 



'1 



J 
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POOLED T-TEST' ANALYSIS BETWEEN 1974 and. 1976 DATA 
* McFarland Elementary 



Planning: t 
Instructing: t 
Clerical: t 



Planning : 
Instructing: 
Clerical : 



1.398 
1.538 
1.641 



.228 
,A78 
.522 



Conrad Elvehjem 



Significant at .178A 
Significant at .1A06 S 
Significant at. .1172 



Cann6t reject 
at .05 levelrf 
(df=19) 



Significant at .8220 (df=20) 
Significant at^ .6377s (df-^0) 
Significant at\6075 (df=19) 



> 



Cannot 
reject at 
.05 level 



STUDENT ACHIEVEMENT 



There exist at least three, seemingly contradictory, avenues/of 
approach to the inclusion of student achievement as an effect oif 
comp'uter managed instruction. One may cofitend that gtude^nt achieve- 
ment is not a justifiable criterion, on whi-ch to judge CMI. Support 
for this contention is that there are too many intervening variables, 
nuisances, and statistical -"noises." These include changes in 
instructional staff, school admlnistratAon, and curricul^r methods, 
and materials as well*as home and community factors and other social - 
variables. Given thefee factors, the relative impracticality of a 
good experimental design may rule out the use of studeat achievement 

data. ' ' - 

« » *• ' 

(^ne may argue, also, that certain a priori assumptions *may be 
made with regard to usage a CMI system. If it is assdin^d mor'e^ 
efficient use* of time,* more effective instructional organizatl^ 
and planning, and better management of resources contribute to 
improved learning (i.e., student -achievement) , then it is that which 
should be evaluated and not the latter.. Stated aqother way, student 
achievement sHould be evaluated indire'ftly t)irough the dimensions 
of functioning and utilization- and not effect.* > '* ' 

^ ■ . ■ . ■ X ^ 

A third approach to this .question assumes that^ if the bbject'ives 
of . the tMI are achieved, a corresponding increase in student achieve-' 
ment should be reflected and' that therein lies the justification 
for implementation and usage of CMI. A longitudinal s4iudy of ^^'achieve- 
ment based on 3ome objective m^a^re • Should reflect a positiVe^ 
trend. 
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•In an effort to address the question of student achievement 
while satisfying the last assumption, the' availability of different 
objective data sources was exaruined. The two most promising sources 
were number of DMP objective.s mastered per student per semester and, 
school-wide standardized' achievement test scores.' * 

\ 

Number of DMP objectives mastered was rejected primarily 
because of the'inability of the system to fix exact dates of mastery. 
Actually, this relates to the student data base being updated at 
once, for objectives Mastered over some, length of tj-me, such as for 
initial placement of' new students. Although there appears to be a 
positive trend in this data, it ift not' possible to draw strong* 
^conclusions from the evidence. 

^ ^> ' . 

The McFarland^ schools administer the Metropolitan Achievement 
Tests to the students once per year. Given below are the ^grade 
equivalen'cy scores for grade four through® seven for four consecutive 
years. The scores represent the testing 6f approximately the same 
§roup of students each year., ' ^ ' * 



r 



Grade Grade Equivalency Grade Equivalency Date of Test ing 

(Reading) (l^athematics) 



4 • • 3:65' ' 3.75 October, 1972 

5 . 5. 33* " 5.93 . - May; 197A 

'6 5.98 ' ' 6.A5 November, 1?74 

im • 7.80 ^ 9.00 May, 1976 ^ 

Figure 2 displays the above infprmatiori graphically. The / 
schbol year- is measured along the horizontal axis qn a ten-moath ' . 
scale, e.g., 4.0 represents the first month or September of the ^th 
grade. The calendar dates, e.g., 10/72,- 5/74, indicate the testing 
dates. A scale of the same proport ion^ is measured along the vertical' 
axis for achievements scores . ' . ^ ' . ^ 

One would expect, based on national norms,- that achievement' 
corresporfti to the school^ year. This correspondence is shown as th^ 
45° lin^ labeled expected . Reading achievement vs* time is sho'wn 
as a solid line while math is represented by the dashed line.^ 

Although student achievement did tend to approach the expectation, 
sound inferences cannot be made with respect to the direct causes. 
It may be hypothesized Chat two factors simultaneously contributed 
to this effect: (1) the faculty and staff preparation for initiating 
. CMI implementation requiring, in itself, some amdunt of self-atudy 
and curriculum analysis and (2) the actual effects associated wi^h 
tho implementation of'*WIS-SIM; 
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It. is r^conunended that, as new WIS-SiM implementation sites ' 
are developed, the question of effect evaluation be addressed in the* 
beginiiiTig, so that complete and "sufficient data is available upon 
which to reach some conclusion. It is also recommended, h9weve'r, 
• that if student achievement is addressed as a system effect; tl^'e 
arguments stated earlier in this section be weighed- I 



COSTS OP WIS-SIM 



Assessment of, the costs 4Df WIS-SIM or any system of computer 
managed instruction is^not easy. Factors affecting costs associated 
with CMI include the overall extent of school use ol the system, 
number. o£ curricula or subject areas supported by the" system, the 
computer system employed, and the turn-around time demanded. 
Additionally, cost figures associated with 'the impleyerftation of CMI, 
as well as the on^jgoing operation and maintenance of ^system hardware, 
s'oftware, and personnel, may vary widely. • , 

In this sect ion, ^costs'assdciated with WIS-SIM during: the 1975-76 
and the 1976-77 years are presented separately. The 1975-76 section 
includes real costs, including implementation, in-service, and 
computer costs, but not teacher and aide time spent in learning the 
system.- The 1976-77- sect ion includes costs associated with the 
Madison Academic Computing Center (MACC) UNIVAC computer for th^ 

, McFarland and ThoreaU (WDRSD) schools.. It is not possible to [Jrov'ide 
exact cost figures associ^t^ed with the interactive front-end on' / 
the R D Center's computer, but these costs were, estimated using 

'^approximate MACC r^tes. Charges include comput&r^osts (hat^dwar4 
and maintenance) and associated support pe^sonrtel costs. llieVosts 
of facilities and facilities maintenance are ^j»ot included. 

In addition to' the above an'alysis, c^ts'of WIS-SIM operation 
are estimated under two simulated conditioias' and for two- levels of 
use. ^'he two' conditions are the machine configurations o^'t^e 
'UNIVAG^ "lllO alojie and the UNIVAC 1110 with the Harris comput^eV "a^ 
a front-end.- The usages explored w§re normal <&nd high. 



1975-76 Costs 



^ , In an attempt to estimate repl costs associated wi^Ch'the imple-^ 

mentation of WIS-SIM in 'a scj>^H a comprehensive co^t analysis was : 
parried out in, the Thoreau /School , Milwaukee .//Costs were prepared - *. 

for school initialization (Table LVI^ inservice (-Tab'le LVH) , and 
^ ^computer costs (Table L\)^IH). Within each of tHeseahree categories,' - 

bot,ii' base cos''ts and tot,al costs are* given, total-c'osts being 170*" 
^ percent of base co.sts, th us re f lec*t ing y^ve rhesd ccysts associste^ 
. with the pfovisfon of computer services suclj as clerical assis-tance, ■ / 

stationery and equipment.. Base costs for 'e*ach category are . . ' 

^realistic-'e'stimaces ba-sed on ac^al 1975-76 salaries andxfists. 
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The tQtal first year cost of WIS-SIM for Henry David Thoreau 
ScKtfol was $5814.52^ This- cbjst assumes a school of 600- 'students , 
located lOQ miles from the central processing site, and running one' 
curricular program. This total co&t is equivalent to a cost of '$9.69 
per student. 



^ ' . TABLE £vi 
COSTg FOR SCHOOL IDENTIFICATION AND INITIALIZATION 



Item 



iase Cost: 



Total Cost 



Notes 



1. 




Field Coordinator; . $156.33/ 
two/bne-day visits to 
""^rTrange fo& data ' ^ o 
connection school 
and one day at. R & D. 

Travel for a}50ve : 
two trips POV, 200 miles o 
each. 

ff 

Computer Programmer:. 

two days se4:ting and * 
initializing: files 
and recompiling 
programs. 

J. \ 
Project Assistants: 25.00 
One day working at 
Center. 



$265.76 



9 " - 



34.00 



156.33 



34.00 



265.76 



42^50 . 



Total include^s* 
overhead (70%) 



$.085/mile 



"fotal includes 
oveish€^li (70%) 



Total includes 
overheads (70%) 



Keypunch: 

30*5 hours @ $4»00/. 
hdur 



122.00 



207.40 Total includes* 

overhead (70%) 
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TABLE LVII 
COSTS FOR INSERVICE 



119 • 



Item 



I 



Inservice Booklets:^ 
40 copies @ . 77 each 



.5. 



taservice pr^^, post, 
and attitude tests: 
40 copies of 3 tests, 
2 pages each and A ^ 
pages answer sheets. 

Staff: Field 
Coordinator for one , 
d^y- and two person ^ 
days of Project 
Assistants. 

Inservicp travel: 
POV for 200 miles 
and 3 lunches. 

.SchoeyL staff: 
40 staff members^ 
for ^/2 day 
\nservice. 



Base Cost 



$'30.80 



10,40 



102.00 



17,00 



800.00 



Total Cost 



$ 30.80 ^ 



, 10.40 
173.40 



17.00 



800.00 ' 



Notes 

Cost figured 
from standard 
Copy "Shop 
charges . 

Cost figured 
fifbra standard 
gcrpy S^op. 
cfharge^. 

Total includes 
overhead (70%) 



$.085/miie and 
$3.00/iunch us^^ 

No overhead 
figu^s used.* 



Follow-up inservices : 
15 'gersQn trips, . 
20p*miles each \ 
^r 1 day each. 



675.00* 



937.543 



Total includes 
overhead (70%) 
on -salaries 



V 
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TABLE LVIII 
COMPUTER COSTS 



V 



(- 



Item 

Initiate System: 
Create files 
and recompile 
programs. 

# 

WIS^SIM Operating: 
fi/le charge $38/month 
report generation 
$ . 35/student /month . 



Base Cost* 



$ 50 



2480.00 



Td^tal Cost 



$ 50.00 



2A80.00 



Notes 

An approximation 
from th$ Thoreau 
Schodl initial- 
ization. 

Based on 600 
students over a 
10-month school 
year, for one 
curricular area^i 
(Note :- ' the 
$.35 stuiJent^' 
mot^h now seems 
a little high, 
but let's^ 
err on that 
"side.) . 



3,.' Telephone, charges: 
$50 ..00 line 
installation and 
clearing, $45/month 
toll charges. ^ 

t 



500.00 » 500.00 



DAIN or local 
service wouW 
reduce these 
costs. 



TABLE LIX 



COMPUTER COSTS 
i 



FOR WDRSD 



Category 


Waukesha 


Wp'arland 


Jackson 


Thoreau 


• 

N'ur.bcr of Runs 


Least 
Der»and 
Month 


Greatest 
Demand 
Month - 


Least ^ 
Deuiand ^ 
Month 


"Greatest 
s. , rrenand 
\ f Month 


Least 
Demand' 
Month 


Greatest 
Demand « 
Month 


Least 
Demand 
Month 


Greatest 
Derar.d 
Mor.th 


Mav 1-976 


Apr. 1976 


Oct. 1975 


^Mav 1976 


Dec. 1975 


Mar. 1976 


Mav 197'6 


Mar. 1976 


22 


107 • 


■ 149 


. \ 
• 362 


24 • 


183 


- 

67 


* 

> 12S 


Express 


0 (0%) * 


0 (0%) 


6 (4%) 


' 1 (.3%) 


0 (0%) , 


, 6 (3%) 


0 (0%) 


2 iX-\ 




8 (36%-) 


'21 (20%) 


■ 104 (70%) 


248 (69%) 


14 (58%) 


f (3%)" 


45 (67%) 


\ 87 ''.63'.) . 


• Overnight 


14 (64%) 


68 (63%) 


28 (197,) 


76 (21%) ■ . 


10 (42%) 


148 (81%) 


20 (30%) 


; 35 (27-) 




0 (o:;) 


18 (17Z) 


11 (7%) 


■37 (T0%> * 


0 (0%) 


24 (13%) 


2 (3%) «• 


4 C.) 


iotai Costs 


• $60.10 
«« • — 


- $102.21 


$302.64 


• 

$350.81 


$63.68. 


$113-81 


^99.48 


$155.37 


Fil^ Storage 


40.30 (677o) 


• 42.01 


48,86 (10%) 


49.03 (14%)^ 


28.02 


30 .^n ' 


40.92 (41p 


41'.^2\'26%) 


: /X r r c s s 


. 0.00 (o:o 


0.00 


13-94 (5%) 


2.19 C.6%) 


0.00 


. _...U.90 


o.od (0.%) 


4.2S 'T) 


.lami'i * 


12.13 (20%) ^ 


26.18 


■214.72 (71%) 


254.60 (72%) 


27.26 


■■ 4.27 


49.41 (49%) 


^5.07 (37%) 


orn irgTTp 


7.66 (13%) 


■ 29.56 ■■ 


t 22.00 (7%) 


36.30 (10%) 


8.40 


60.3^ 


•8.31 (8%) 


10.15 (12:0 


' Weekend / 


O.yDO (0%) 


4.^.6 . 


3.12 (1%) 


8.69 (2%) 


• "0.00 


4.49 


0.84 (0.8%) 


1.'? (:■:) ^ 


btucont^ Eiirollea 


* 

573 


. 510 


680 


- 

- 701 


450 


451 • 


620 * * 


630 


iOtai Costs/ Student 


O.IO 


0_'. 18 ■■ 


0.45 


■ . 

0.50' 


- 

0.14 


. 0.25' 


\ 0.16 •■ ' 


• 0.22 


rile Storage 


0.07 


1 ,Q..07 


U . U / 


U . U / 


0 . 06 


0 . 07 


a. (^7 ! 


0.06 


Kxpross ' , 


0.00 


0.00 


0.02 


0.003-. . 


0.00 ■■ 


0.03 


0.00 , 0.007 


Nor-al 


0.02 , 


'O.Cf5 


0.32 


0.36 


0.06 • 


0.01 


0.08 0.1^ 


^'ernight 


.0.01 " 


0.05 


■ 0.03 


0.05 - 


0.02 


0.13 


o-.pi 


■0.03 


'^v\ee':ep.d 


0.00 


0.01 


■ 0.005 


0.01 


0.00 


o-.oi 


"•T:^ /I 


0-003. 


\ 

^ Coses/Report 


2.73. 


0.95 . 


2.03 


0.97' 


2.65 


-0.62 


1.48 - 


1.21 


File Storage 


1.83 


' a. 39 


0. 32 


• 0.13. 


1. 17 


0.17 • 


0.61 


0.37 


Ex^press 


■ 0.00 


0.00 , . 


2. 32 


2. 1'9 


.0.00 


2.31 


0.00 


2.14 


N'ornal * ' 


1.51 


.* 1 . 2,4 


2.06 . 


1.02 . 


1.94 


0.85 


1.10 


1.02 


Overnight 


0.5A 


0.43 


0. 78 


0.47 " 


0.84 


0.40 


0.41 


C.54 


We'ekend 


i 0.00 ' t 0.24 


0.28 

^ ^^—^ ^ 


- 0.23 


0.00 


0.1$ 


0.42 L 


0.44 
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TABLE LX 

CdMPUTER COSTS WDRSD BY REPORT TYPE 
Two- Weeks in December 1975 



ft 

r 



Reports 
Schools ^"^s. 


ipp_ 


1 

Grading 


IGR 


SSF 


UPP 


Total 


HcFarland 


16.81 

18 
= 0.93. 


^ — 

26.54 

32 
= 0.83 


8'. 43 
4 

= 2.11 


0 
0 


4.18 

3 

= 1.39 


55.96 

58 
= 0.9^ 


Jackson 


0 
0 


^ 3.97 
4 

= 0.99 


5.02 
3 

= 1.167 


0 
0 


\ 

1.42 
1 

= 1.42' 


. 10.41 • 
8 

= 1.30 


Waukesha 


0 
0 

*• 


^9.04 


1.74 
• 1 ■ 
= 1.74 


. 71* - 
1 

" = .71 


, 3.99 

. 2 

= 1.55 


<JL4.58 
= 0.^99 


Thoreaa 


.35 

1 

= .35 


0 

0 - 


8.62 'y 

= 4.31 


1 N 

=. i.02 


13.24 
5 

= 2:65 


'22.88 
' 8 
. = 2.86 


TOTAL 


17.16 
■ 19 
= 0.90 


"'33.55 - 
47 
= 0.71 


23.81 

' 10 
= 2.38 


1.73 

- 2 

- .87 


18.93-r 

'ir 

= 1.72 


104.18 

89 
•= 1.17 

> : 
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Data on total costs per terminal site, costs per student, costs 
per report, and costs per. program were logged at the R&D Center 
for each of the months,, September 1975 to May 1976, foi*^ bot'h 
McFarland and Waukesha and frotn January 1976 to May 1976, for each 
of the four terminal sites. The costs analysis presented in Table 
LXIII summarizes this monthly' data by' presjenting the data for both 
the month of smallest demand and the month of greatest demand for 
each terminal site. Because the costs reported are based exclusively 
on computer time, they are directly ^dependent upc^ 'computer usage. 
Also, |)ecause users can request different sp.eed^ of receiving 
, reports^ (express , ^normal , overnight, and weekend rates), the total ' 
costs to users will reflect these different typeg of delivery 
service, each of which have dif ferent^osts . ^Theisafore, cjosts have 
been broken down in terms of these four categories. 

Costs reflect ^yst.em linage, with the cost per student of the 
highest usage scheJ'ol, McFariand, being several times that of the' 
smallest usage ^school , Waukesha. A cost per student estimate for 
WIS-SIM/WDRSD of between- $. 25 and $,A0 would seem -approximate Ij^^ 
correct. * . • ^ 



/Table LXIV show^ costs for WDRSD rep^orts tabulated by report 
'type. The ^a'ta for this table were collected during the first two 
weeks of December 197^. Mean costs, number of requests, and total 
costs\for each report and for each school are shown. * Fbr example, 
,the McFarland Schools made 18 requests for Individual Perfor'mance 
Profiles (]iPP's)'for a total cost of $16.81 an^ aff'^verage cost of 
$..93. Total and average co^ts for the 89 reports requested during 
this period we re $104.18 and $1.17 re spe c t i ve 1 y . * 

' A similar cost analysis to that of Table*, LX was not available for 
^DMP and SAPA because of the different acU:ounting system used by the 
R&D Computer Center ,'^which processes the DMP and SAPA progifains. 

1976-77 Costs* ' * ' ^ ^ . \ 

Little exac;^ information regarding t,he total 1976-77 costs, of 
WIS-SIM as uMliz^ in the McFarland ^chools and at Henr^ David . 
Thoreau is available. * This is due, trt part, to the difficulties in 
discerning what- costs are associat^or can be directly attributed 
to CMi usage; as opposed to activities that would normalp^y exist in 
Che school without pMI atid, al6o,'"what costs are related'ltq the 
development of the system. ^ ' 

, At Thoreatr; the CMI activities'^re coordinated by the reading 
specialist, 'this person both directs the reading program of the 
school, in' conjunction with the unit leaders and teachers, and 



\mariages the use o'f CMI. 
teacher aide ^ho operates 

multiplicity &f their- respective resp>fisTBTrti4i-iesx, it iax-^tfTrSicult 
to assign a percentage of personnelytosts resultii^g_£j?<^m (^m. uVage. 



Th^- reading specialist is assisted^by va ) 
the computer terminal. .Because of thW 
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Both positions existed prior to CMI implementation and we^^e, therefore, 
not created as a result of system personnel requirements. Othei; 
costs at Th6reau associated' with the system are for the^ computer 
terminal, whiAt is presentl)^supplied by the R&D Cen«r, for 
dedicated telephone line charges, and for long distance. 

The IJcFarland Schools emplqy a full-time CMI pr^Tject director 
and a full-time aide to operajte the computer terminal. McFarland is 
somewhat unique, and an even more , difficult site^at which to decipher 
costs, for several reasons. McFarland operates C^I through/unds 
provi'ded under Title IV in addition ^o support provided fE6m the 
R &.p Center. Associated with this program are extra tasks — ' 
including developmental' activities, p li ning, and evaluation. 
Many of these activities would not riPRsarily be existent under 
Cypica^L conditions. ^ . \ 



f 

J 



Because of McFarland ^s hi^h use of the system that supports 
three separate curriciilums (WDRSD, DMP,,and SAPk) , and because of 
physical separation of the school's two main buildings, two terminals^ 
~and a sheet, scanner are used. 7 Presently^ one terminal is leased, 
while the other terminal and sheet scanner are provided by the 
R&D Center. Necessary tel'ephone service and dedicated lines are 
also associated . expenses . 

At both McFarland and'Thoreau, it is felt that at least a 
part-time (25-50 percent) coordinator for CMI Activities is both 
desirafe.le and necfe'Bsary. .Also, some personnel are ^required for 
terminal operation. Depending on the- level of use, the personnel 
requirement may- range from a half-time, tfo full-time aide position. 
The computing costs for the >two schools are given in Table XV, which 
reflects costs associated with hi^h and low'usage months. These' 
figiltes represent only 3' portion of the computing cost, however. 
'Since* they includp only the MACC costs Tor WDRSD, one must assign 
.a jcost for the interactive front-end, which operates on the R&D 
Center computer. This**may, in some cases, approximate the given 
MACC charge, depending on the nature of computing demand. »Co9ts 
for oCher currTculym support, i.e.,' DMP and SAPA, would result in 
additional computer costs: 

As reflected in Table LXV, the demands at t)/e two schools ^vary 
considerablySas do the costs per'stqdent andJzlie 'co^ts pefr report. 
The number of runs at McFarland is approXimSfely three to four times 
that; of Thoi;eau school, while McFarland's student population is only 
one-and-pne-half times, larger^. Total cost/s reflect ttv^number of 
runs and th^is^is, also, three to four timeV as large for McFarland 
as for Thoraai^^. Cost per student, reflecting the larger combined 
siz/e of' the McFarland schools, is only two' to three times higher for 
McFarland. The cost per report is, greater fot Thoreau-than for 
McFarland, almost double for the high demand month. As noted, the 
variation in use makes it difficult to fix system costs; but the 
approximate figure would be between $,"20. and ''-$.4 5 per student per 
month for Che costs included in this estimate? ' 
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Category 



Students Enrolled 

Total Costs/Students 
File Storage 
Exprejss. 
Normal 
• Overnight 
Weekend 



TABLE LXI 
CO>ffUTER COSTS FOR WDRSD (1976-77) 



McFarland 



Low Demand- 
, Motith 

iOctob-er, 1976 



High^ Demand 
Month 

November, 1976 



Costs/Report 

File Storage 
Express. - ^, 
Normal 
Overnight - 
Weekend " 



•737 

.41 
.07 
.01 
-.30 
.03 
'.005 

$1.31 
.22 
1.92 
1.^ 
.56 
.19 



745 

.48" 
.07 
.03 ■ 
.32 
.05 
>. 006 

$ .94 
.13 
2.77 
.94 
.40 
.21 



Thoreau 



Low Demand 
Month' 

November, 1976 



Number of Runs 




(100%) 


377 


(100%) 


83 


(100%) 


Express 




( 1%) 


9 


( 2%) 


0 


( 0%) 


Normal 


' 167 


( 73%) 


253 


■( ^7%) 


26 


( 31%) 


Overnight 


38 


( 16%) 


■ 94 


( 25%) • 


37 


( 45%) 


Weekend 


22 


( 10%) 


21 


( -6%) 


20 


( 24%) 


Total'Costs * 


$300.99 


(100%) 


$355.24 


(100%) 


$85.63 


(100%) 


File Storage 


50.49 


( 17%) 


49.47 


C 14%) 


37. 4§ 


( 44%) 


Express 


5.77 


( 2%) 


24.94 


( 7%) 


0.00 


( 0%) 


Normal 


219.19 


( 73%) 


• 238.99 


( 67%) 


25.45 


(-30%) 


Overnight 


^21.46 


( 7%) 


37.49 


( 11%) 


15.64 


( 18%) 


Weel^nd 


4.08 


( 1%) 


4.35 


( 1%) • 


7.06 


( 8%) 



553 

.15 
.07 
.00 
.05 
' .03 
.01 

$i.>03 
.45 
" .00 
-.98 

il 



High Demand 
Month 

/October, 1976 



(100%) 
( 0%) 
{ 40%) 
( 31%) 
( 29%) 

(100%) 
( 17%) 
( 0%) 
( 66%) 
( 6%)- 
( 10%) 



65* 
0 
26 
20 
19 

$144.74 
24.28 

0.00 
96.24 

9.03 
15.19 



549 

' .26 
.04 
.00 
.17 • 
.02 
.03 ' 

$2.23 
.37 
.00 
3.70 
. .45 
.80 



* Although fewer reports were ploce^sed,- the costs for normal and weekend processing were 
tonside-rably higher, indicating larger run sizes and, greater demand for system resources. 
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In an effort to ptoject anticipated computing costs,' Table LXVI 
provides estimates of charges associated with each of the three • 
curricula (WDRSD, 6mP, and SAPA) presently supported by WIS-SIM 
individually, as a total, and as a total per student.' These costs ^ 

^are figured at a high level of use' such as that at McFarland. 

Costs are given for the five levels of turn-arojjnd priority: 
DEMAND, EXPRESS, NORMAL, DEFERRED, and CONVENIENCE, and at a mixture 
of priorities, XNDC. The XNDC mixture is a percentage combination 
based on a sample of priorities requested during a typical month, 
i^osts listed under the heading 1110 are for the entire system running 
at MAtC on the Univac 1110. Those costs listed under 1110-H are for 
using the R&D Center's Harris computer as a front-end to the 
Univac 1110. A total cost of $3.75 per student per month for , the * 
XNDC mix is noted for the' three programs. When using the 1110 with 
the Harris front-end, the cost is $2.15 per student per month for a 
'high usage school. 

Table LXVII reflects costs associated with WDRSD support at a 
normal use level, such' as that at Thoreau. The same levels of 
priority are given as i,n the previous p-rojection. All costs in 
both tables are on a monthly basis. To oigmpute yearly costs, a 
multiple of nine should be used. The number in parentheses after 
the curricular program indicate thje- number of runs used in the 
calculations; in this case, 90 runs. 

As would be anticipated, the costs for normal use are consider- 
ably less than those for high use. A comparison for WDRSD in 
Tables LXVI and LXVII shows normal use cost to be about .4 to .6 of 
high use cost. 

Table LXVIII provides a graphic represe*ht^ation of costs per 
student under normal and high use, for three curricular programs, . 
and'fqr various school sizes.' Costs are fairly stable as school 
size grows beyond 400 students. r> 

As has been noted, the assessment of cost of the operation of 
a computer syste^i such as WIS-SIM is an extremely cqmplex undertaking 
One major issue i? what cogts are to be included in the, estimate, 
These^ costs could include computer use,' system support personnel, 
hardware maintenance^ facilities, environmental control,* fa'cilities. 
mainteniince, training p*sonnel, inservice materials, equipment 
located in the s'chools, and teacher^and aide time for training. 
'Second, it is important tb diatiinguish between additional coats and 
replacement costs. Some costs are offset Ijy existing expenses. 
*Many of the* operations supported by WIS-SIM were, presumably, 
carried out manually prior to the Implementation of *the system. * \ 
Previous expenses would offset d major portion of system eosts. 
Still, the. implementation- of the system appears to result in an 
increased school expenditure. The question is .whether this 'increased 
school expenditure is offset by^' inpreased student learning. This 
report does not permit the direct assessment of cost-benefit, and 
only a local school district can determine whether a given ' benefit 
per cost is possible and desirable fen: them. 
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'^'TUTIIJG COSTS FOR WIS-SD! (ii'lGFi uS 






1 DMP (220) 


SAPA (180) 


WDRSD (300) 


COMB (700) 


1110 


*RC TOT TOT/STU 


RC TOT TflT/t^TTI 


T3 P TAT" T/^T /PT"TT 


RC TOT TOT/STU 


, DEMAND 


$1204 $1633 $2.30^ 


^$909 $1349 SI QO 


~z ^ " 

9l-)il 9iyol . 9Z.0U 


$3634 $4524 . $6.45 


EXPRESS 


$ 904 $1333 $l;90 


$682 $1097 ss 

yj.V/?/ yJ-.JJf^ 


9l30i 9Z*25 


$2726 $3616 $5.15 


NORMAL 


$ 602 $1031 $1.50 


$455 $ 870 ?S 


I? /Dl plzOl $1.70 


$2024 $2914 $4.15 


DEFERRED 


$ 512 $ 941 $1.35 


$387 $ 800 1 ^ 

y.^u/ y 0\J\J yX.J.j^ 


P OHO ?1086 $1.55 


$1545 $2435 $3.50 


CONVENIENCE 
— k 


$ 422 $ 851 $1.20 




^ 5j2' $ 972 $1.40 


$1272 $2162 $3.10 


XNPC' 


$ 572 $1001 $1.40 




* 

? 722 $1162 $1.65 


$1727 $2617 $3.'?5 


1110-H 










DEMAND 


$ 904 $1254, $1.80 


$682 $1032 $1.45 


$1141 $1473 $2.10 


$2727 $3365 $4.80 


EXPRESS 


$ 602 . $ 9^2 $1.^35 


$4514 $ 804 $1.15 


$ 760 $1092 "-$1.5? 


$1816 $2454 $3.50 


NORMAL 


$'301 $ 651 $ .95 


$227 $ 577 $ .80 


$ 380 $ 712 ' $1.00 


$ 908 $1546 $2.20 


DEFERRED * ' 

V 


$ 211 .$ 561 $ .80 


$159 $ 509 . $ .75 


' % 

$ 266 $ 598 $ .-85 


$ 636 $1274- $1.80 


CONVENIENCE 


$ 120 $ 470 $ .65 


$ 91 $ 441 $ .65 


$ 152 $ 4;84 $ .70 


$ 363 $1001 $1.45 


XNDC 


$ 286 $ 636 $ .90 


$216 $ 566 \^$v.80 


$ 361 $ 693 $.1.00 


$ 863 $1501 $2.15 



*^RC = Run Charges 

TOT = Run Charges Plus File Charges ^ 
TOT/STU = TOT Charges Per Student on a Basis 



of 700 Students 
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:e lxiii 

cpkputing costs for wis-sim (normal use) 



r 



• 




WDRSD 


(90) 




1110 


RC * 


TOT 


tot/st'u 


^ — 

DEMAND 

i- 


$414 


$778 


$1 


.10 


EXPRESS 


$310 


$674 


$ 


.95 


N0W4AL 


" $207 


$571 


$ 


.80 


DEFERRED 


$176 


$540 


$ 


75 . 


CONVENlfetfCE 

r 


$145 


*^ "$509 




/u 


XNDC _ ' 


$19 7 


$5*61 


$ 


80 


lllO-H 










DEMAND^ \ 


' <'$310 


■ $642 


$ . 

* 


90, 


EXPRESS 


$207 


$539 




75 


NORMAL . 


$104 


$436 




60 


/DEFERRED' ^ ' 




_$404 


$ 


58 


CONVENIENCE 




*' $373. 




53 




$■ 99 


,$431 


$ . 


60 



f 



r 



*RC=Run Charges TOT=Run Charges Plus File Charges 



fOT/STU=TOT Charges 
Per Student on 'Basis 
of 700 Students 
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CHANGES IN SCHOOL OPERATIONS 



School Operations Sunnnary 

" \ I 

In Ma>? 1976 and Acfril 1977 , administrators and unit leaders at 
each of th^ user, schools were surveyed to determine the extent of 
changes^ in! school opeyrations made as a result of ir^plementing 
WIS-SIM, bperationay changes were taken to include new activities 
introduced as a^r^sult of WIS-SIM, activities deleted-as^a rfesolt . 
of WIS-SIM, and activities modified as a result of WIS-SIM. . , 
Respondents wei^ asked to list such actiMities under the headings of 
inservices, meetings, consultations/with project staf^, changes in 
the schoc/l schedules, changes in communication procedures, and' ofher . 
changes^n school operations. The questionnaire used in this survey 
shown in Appendix C, » - 

^: ' . . / . . 

Respondents were asked to describe in a sentence each such- 
change, noting the length in time and frequency of the activity where 
his was' relevant. The number of respondetits to Che May 1976 survey 
shown in Table LXV. 




TABLE LXV 



NUMBERS OF RESPONDENTS TO CHANGES ll\ SCHOOL 



OPERATIONS Sl}RVEYrl976 



McFarlan<i 



Jackson 



Plpver-Whiting 



Unit Leaders 
. 1 



min istrators 
1 

"1. 
2 



B^rstow' 

?Iorthview 

• / 

' Henry Qavid Thoreau 



2 

2 
6 



Total 



15 



» The respon^i^nts at both Barstow and Pf over-Whiting indicated no 
changes other than an initial inserviCe and meetings with project 
staff approximately once per , month, or when requested. Generally, 
the 22f Respondents reported little in the way of changes' to school 
operations as^a Result of WIS-SIM, and it can.be concluded that 
WIS-SIM has not resulted in any significant operational changes. 
Typical responses are outlined below» 
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Inservice . ^ All schools jjeported the half-day inservice at the 
commencement of * the" 1975-76 school yeajr. 



Meetings . Besides th^ usual .unit meetings for grouping purposes, 
McFarland found a need for units to meet with the CMI project 
director a few times each seme^^r for /the purpose of disseminating 
current CMi information and modifications. The principal* of the 
McFarland schools also- reported meetings with WIS-SIM project staff 
several times per year^ The Thoreau School reading specialist, who 
has primary responsibility for implementing WIS-SIM procedures in 
that school, reported meetings with teachers and the principal once 
every two weeks. , • ' 

' Consultations . Because of the full-time appointment of a CMI 
project director at McFarlarfff, unit! leaders reported daily consulta- 
tions with the director. Conteultations with R. & D staff were- ^ 
reported at 1-3" per year, in Addition to an occasional telept)one 
consultation^ The principal at McFarland reported a weekly, 30- 
minute consultation with the project director. All schools reported * 
^Z-3 \consultations per ye^r with the R&D Center staff. More often 
^ thanjnot, respondents — mostly administrators — noted thes^ consultations 
asj^elpful. * * . , 

Changes in gchegyles . The Notthview principal noted Jthat unit 
leaders were now spending more time in the classroom. McFarland 
reported some change^in schedule to facilitate . inter-unit groupings. 
No ottrer schedule changes were reported. * 

Communication Procedures . Three schools, McFarland, ' Nor thview, 
and PloverrWhiting, .reported using IPP's for parent conferences. 
McFarland reported that there was*^a need for more inter-teacher 
communication to ensure the proper and timely submission of scores 
and requests. One McFarland unit repprted the use of IPP's by 
.stud^n-ts for their own record keeping. 

^ There apj>ears to have been little or no change in school 
operations because of the'' implementation of WIS-SIM. More meetings, 
consultations, and communication generally seem .to have occurred as - 
a result of implementing WIS-SIM in McFarland, where there are a 
full-time proj^ct~-d4Hrector and project assistant, and all units are . 
using WIS-SIM for at least two instructional programs. It, therefore,' 
appears that changes in school operations may be related to the 
amount of usage made of th*e system. Considering the limited use 
'ma^e of WIS-SIM by most of the other user schools, it can be con- 
cluded that these schools did not experience any significant bpJerationaf 
changes when implementing WIS-SIM. This may be a trend for future 
user schools that begin -to use WIS-SIM on a limited basis.' 

f 
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Analysis of 1977 Survey 



Table "LXVI lists the number of persons resp'bnding to th^ changes 
in school operations questionnaire in the April 1977 evaluation, t 

A ■ ^ ■ 

' TABLE Lm 

NUMBER OF RESPONDENTS TO CHANGES IN 
SCHOOL OPERATIONS QUESTIONNAIRE^977 



School 
Mc Far land 

Henry David Thoreau 
. - Total 



Unit Leaders 

5 

5 
10 



Administrators 

1 (principal)^^ 

2 (principal^ & reading 

specialist) 

3 ^ '13 



ERLC 



The respondents at Henry David Thoreau indicated no changes in 
school operations other. than those associated with student reports 
and record-keeping. As in 1976, little change in operations was 
reported by staff members surveyed. This may be, in ps^rt, due to 
Thoreau*s use of CMI for the second' consecutive year and McFarland's 
use for the third consecutive year. Most changes resulting fronr 
CMI use would likely be incorporated into the routine activities ^ 
and operations by this time. Responses to the survey are summarized 
below.' . • ^ / > . . ' '"^ 

Inservice . ' The<^service for staff members of the user sch'ools 
in the fall of 1976 wa^ reported. Two respondents indicated the 
need for more ipservice and a review session. 

Meetings . Thoreau indicated nO change in meetings.* McFarland 
reported that the need for unit meetings for the purpose of grouping , 
is rare, due to CMI and to teachers sharing grouping respo'nsibiliti,es . 
Unit'm^tings are held once ea^ semester >7ith .the CMI coordfnator 
for the purpo^ of clarifying needs and ex^ia^ation of new services, 
i'he McFarland principal indicated much time wad^^ent writing 
the proposals and pointed out the need for pei:aodic nteetings with 
R D Center staff. The McFarland p^-oject director ^reported regular 
meetings were necessary fbr evaluation purposes associated with the 
project activities. ' ... 

Consultatior\s with Curriculum Specialists . The reading specialist 
at Thoreau reported that consultations had increased considerably. 
Contact was^ made during the year every two to tljree weeks. The 
Tftoreau principal indicated an in(!\rease iji consultations regarding 
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evaluation. Tlie McFarlapd st^ff reported consultations of varying • 
frequencies. Two units heTd formal, scheduled .meetings once per 
semester while one unit met once a 'month. Informal consultations » 
with McFarland's CMI project director were held as needed. The 
McFarland principal indicated t4xe need *for occasional meetings wtth 
representatives of the- Department of PuSlic Instruction. Several 
respondents reported a decrease in the" frequency of consultations 
as compared with last year. ^ ' 

Changes in School Schedule . All of the McFarland respondents, 
except one, indicate^d there had been no schedule clianges. OTne uni,t 
leader, however, reported that students >began using IPP's to plan < 
individual schedules in Study Skills atid Comprehension and^that this' 
saved some scheduling of classes. Also, the same respondent reported^ 
that, occasionally, the "schedule was changed becausfe ^oupings -^ere , 
not available. Thoreau reported no changes in school ^schedule . 

Changes in Communication Procedures . The Thoreau reading 
specialist noted no great changes except for communication with 
parents^ who requested information. . SeK^eral McFarland respondents 
also pointed to better communication ^Lth parents regarding skills 
accomplished by students. One McFarland unit reported the use of 
CMI for math progress re{:u)rts, thus [reducing teacher preparation 
, of these reports (academic portion)) the teachers contin|ie to 
prepare the personal development portion of reports. . 

J ^ ' ' \ ' . 

Other Changes 'in School Operationsl McFarland noted the use of 

I individual checks on homeroom students ' Vprogress' twice monthly^ in • 

^ach area, ^e McFarland principal ^ndibaied much time spent with 

^ visitors to the school. ThoreaG reported tkat record-keeping tasks 

/ , ^ bad been shortened with the use of CMI 'reports thit replaced the 

manual methods. ^ . ' 

' * ' \ 

As in the 1975-76 school year,- there kpp^,afT)D have b^en few. 

Ichanges in the overall operations of the uier schd(pls as a result of 

.|:he in}plementation of WIS-SIM. McFarl^d deports rtore change than. 

Thoreau, vhich is to be expected, given xheVr hi^h levelNof CMI ' 

lisage in three cutr^cular areas and, also, 'the presence o? a full-time 

CMI project director. Even there, however, Tittle change was reported 

except at the classroom level.^ Since CMI assists' ih the management 

of an existing organizational structure with existing' curricula, 

little change would be predicted. , , ^ 

STAFF ATTITUDES TOWARD WIS-SIM 

Administrators, unit leaders, and teachers in each of "the seven 
user schools were surveyed in May 1976 to ascertain u^er perceptions 
of WIS-SIM' s effects (1) on improving the quality of instructional 
decision- making, (2) in providing better use of time, and (3) in 
providing better •information- to parents. Comparable information was 
not collecD^d as a part of the 1977 evaluation. 

«^ 
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The results from th^ two McFarland schodis-we^e cons^idered 
jointly because .separate school identities were not coded onto the * 
questionnaire forms and because^ these two schools operate as on^ 
in many resp-ects. The number of respondents i^s shown In Table LXXI 
below. ^ Only those staff^who had used WIS-SIM services were -asked to 
Complete the questionnaire. , " ' * 



TABLE LXVII 



RESPONDENTS JO QUESTIONNAIRE ON ADVANTAGES OF WIS-SIM 





Administrators 


Unit Leaders 


Teacher^ 


Total . 


1 :LFarland 


1 ^ 


- ' 4 


6* 


11 


i ' Jackson 


1 » • 


1 


2" 


4. • 


-Plover-Whiting 


1 


1 


4 


. 6 


BaTStow 


1 


2 


5 


8 


Northview 


1 


2 


10 ■ 


13 


Thoreaiv 


1 




6 


; 11 


All Schc^ols 


6 


14 


33 


53 



Tables XXVIII to LXXX give the. proportion of respondents by 
staff category, within each school, and across all schools for each 
possible respons'e. Each of the first six questions (11 parts in all") 
was presented in the form of a 5-point rating scale, and the responses 
are shown as frequencies and .propprtjLons under each of the *f ive 
possible responses. A summary of the me3n, overall ratings is ^ 
presented in Table LXXXV. ^ 

\ 

The ratings o¥ tTie responsiveness and utility of WIS-SIM is^^ on 
the average across alj ratings, are at -about th^ mid-p«>int of the 
five-point Sfale. This fs not a very positive ffnding. Several of 
the forbs, as indicated by the summary in Table LXXXI, were rated 
below the mean (i.e., more responsive and useful): quality of 
decisions regarding instructional planning and student* groupings, ^ 
effect on comprehensiveness of instructional program, effect on the^ 
sequencing of skills of instructional programs, effect on*meeting 
individual student needs, effect on student achievement and effect 
on quality of information. ?Tne item questioned ' the extent to which 
Wrs-SIM had replaced the teacher as an instructional decision maker. 
The* response^ not at all, was a3 anticipated. 
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TABLE XXVIII ( 
RESPONSIVENESS OF WIS-SIM TO NEEDS FOR INFORMATION MANAGEMENT 



School 


N 


• Very Responsive Not at all Responsive 


Me/in 


' 1 • 2 3 4 5 


McFarland 

Jackson 

Plover-Wfiiting 

Barstow 

Northview 

Thoreau * * 


11' 

4 
6 
8 
1-2 
11 


3.7 1 

12 1 

1 1 ■ 1 ' 1 2' ' 

1,7 1 3 

13 6" 1 ■ 

' ^ - ^ 


1.82 

2.00 ■ 

3.33 

5.00 

3.50 

2.73 


All Schools 




6 (11%) 14 (27%) 16 (31%) 2 <4%) 14 (27%) 


3.08 


, . ■■ ' — ' • 

TABLE LXIX ' - * ^ . 
RESPONSIVENESS OF WIS-SJM TO NEEDS FOR INSTRUCTIONAL DECISION IIAKING 


School 


N 


Very Res]ionslve Not at all Responsive 


^ean 


■1 2 3 4-5 


' McFarland 
Jackson ^ 
Plover-Whiting 
•Barstow , 
Northview 
Thoreaa 


11 

4'>> 
6 

12 
11 


— : 

• t - 

,3 7 1 , , 

1 -1 .1 3 

8 

'2,5 2 ■ 3 

3. ' 7 ' 1 * 

■ i £. 


1.82 

2.75* 

4.00 

.5^00 
3.50 
2.?6 ^ ' 


-All Schools 


52 


3 (6^ 14 (27%) 17 (33%y 3 (6%) 15 (28%) 


3.25 


/ * 

J - ■ . • 


k 
t 
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• TABLE- LXX ' " ' .< 

RESPONSIVENESS OFoWISrSIM TO NEEDS FOR INSTRUCTIONAL PLANNING 

I 

- ^ - - 



V 

^ . School , 


. , N ' 


very Kesponsxve nql ac slma. ixesponsive 


Meaiv V 


1 ■ 2.3 '4 5- . 


McFarland 
* * Jackson 

Plover-Whiting ' 
Barstow 
Northview ' 
Thoreaci 


■ 11 
. 4 
■6 
& 
' 12 
IK 


3 6-2 

.1 2 1 

1 .1.2 2 

• '8 ■ 

• 1 6' . 2 ■ 3 , 
2 / 2 • 6 ■■ • 1 


t 

1.91 ■' 

3; do . 

3.83 
5.00 
3.58 , 
2.27 


-t-. ■ 

All Schools 


52 


^ (10%) 11 (21%) 17 (33%) 5 (lOJi) 14 (-27%. 


)3.23 


\ - 

• * < 

^ ^ X ' ' TABLE LXXI * . . 

' . * > . * ' • . ^r ^ 
CHANGE IN AMOUNT OF '^^IME , SPENT IN* INSTJIUGTIONAL "PLANNING 

" ' AKD GROUPING STUDENTS , • 


School 


N 


J Much Less Time " Mucti More Time 


Mean 


'1 2. . ' 3 V 4. 5, • 


'McFarland 
Jackson 

Plover-Whiting 
.Barstow ' 
^^orthview. , i 
thoreau 


. 10 
. 4 
6/ • 
8 
11- 
9- ' 

I 


3 . 3 ' 2 1 1~ 
1 • , • 2 - 1 

. . -3 r 2 • 

% 1 4x^-2 

r " 8 - -1 ■ 


2.40 
- 2.7!' 

2.87 
' 3.00 

3.64 

3". 11 


: > 

Ail Schools 

• * 


48 


4' "4 .27-8 5 " 
..(8 1/2%) (8-1/2%) 06%) (16 *2/3%) (10%) 


3^12 



•V ^ • • ° 137 . 

TABLU: Lmi 

QUALITY OF DECISIONS RE INSTRUCTIONAL PLANNING AND STUDENT GROUPINGS 



bcnool 


N 


Mifch Higher. Quality , Much Lower Quality 


Mean 


, 1 ■ 2 3 4 • 5 • 


• 

McFarland 
Jackson 

Plover-Biting 
. Barstow 
,Northview 
Thoreau 


11 

4 

8 
12 
11 


4 6-1 ] 

1 3 . \ 
.1^3 2 

6 2 

2 8 2 ' • 

4 4 2 1 ■ 


1.73 
2.75 
3.50 
3.50 
3.00 
3.00 


All Schools 


■ 52 


4 (8%) 14 (27%) 25 (48%) 4 (8%) 5 (9%) 


2.85 


1 

TABLE LXXIII „ 

EXTENT THAT COMPUTER HAS REPLACED TEACHER AS INSTRUCTIONAL - 
• ^ DECISION MAKER 


School ^ 


N ■ 


Very Much Not at all 


Mean 


I 2 3 4 . 5" ^ 


McFarland 
Jackson 

Plover-Whiting 
Barstow 
Northview 
Thoreau ^ 


11 
4 
6 
8 

13 
' 11 


\ 

1.1 4 ^1 : 4 ' 

1 ' ' .1 • 2 
1 5 
8 

1- . -3 , 2 ' 7 

1 10 • 


3.54 
4.25 
^.67 

5.m 

4.15 
4.91 


All' SchooIs(^ 


53 


1 (2%) 2 (4%) 9 (17%) 5 (10%) 36 (68%) 


4.38 
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TABLE LXXIV 




\s ' HELPFULNESS OF WIS-SIM OVERALL 



School 


N 


Very Helpful 


Not at 


all Helpful 


Mean 


1 


2 




4 


5 










# 






1.73 


McFarland 


11 


5 


4 


2 




V 


Jackson 


■ 4 


1 


1 


2 






2.25 ■ 


Plover-Whiting 


6 




2 




2 


2 


3.67 


Barstow 


8 . 






3 


1" 


4 


■ 4.12' 


Northview 


13 






5 - 


7 


1 


3.-69 


Thoreau 


11 


'■ 1 


1 


7 


. 


1 


3.00 


'All Schools 


53- ' 


^ 1 (4%) 


8 (15%) 


19 (36%) 


11 (21%) 


8 (15%)' 


3.09 



TABLE LXkV ^ . 

CHANGE IN PROPORTION OF TIME SPENT TEACHING 



School 


N 


Much. Larger Proportion Small Proportion 


/ 
Mean 


1 Z 3 4 '5 


McFarland 
Jackson 

Plover-Whiting 
Barstow 
* Northview ^ 
Thoreau 

* — 


^ 10 
4 
6 

. 7 . 
^12 
11 


1 '2 6 1- 
3 1 

' ^ ■ 4 1 . 1 ' 

(}"-*& I 
\ 1 '8 ■ 2 1 

V , 11 • ■ 


2.10 
3. 25 
3.50 
• 3.28 
3.25 
3. DO 


All Schools . 


50 . 


1 (2%) (6%) ' 38 (76%) y (10%)' 3 (6%) ' 


3.12 ' 
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f TABLE LXXVI 

WIS-SIM'S- EFFECT ON COMPREHENSIVENESS OF INSTRUCTIONAL PROGRAM 



School 


N 


Much More Comprehensive Much Less* Compreh. 


Mean 


1-2 -3 - 4 5__ 


Mf Farland 
Jackson 

Plover-Whiting 
BajTstow 
Northview 
Thoreau*^ 


11 
4 
6 
7 
11 
11 


3 6 1 . 1 

1 -3 ■ ' , • ■ 

1 ■ 1 3- — 1^^' 

6 ■ 1 ■ 
■2.5' 3 1 . 
1 . 1 9 . . ■ 


2.00 
2.50 , 
3.33 _ 
3.28 
, 3.27 
2.73 


All Schools 


50 


6 (12^) la (20%) 24 (48%) 7 (i4%) 3 (6%) 


2.82 



TABLE LXXVII 
WIS-SIM'S EFFECT ON SEQUENCING ipF 

4 

SKILLS OF. INSTRUCTIONAL PROGRAMS 



School 



Muctt Higher Quality Much Lower Quality 




Mean 



McFatland 

Jackson * 

Plover-Whiting 

BarstoW 

Northview 

Thoreau 



11 
4 
6 
6 
11 
11 



4 
2 
1 
6 
6 
9 



1 



1 
1 

r 



2.ia-r 

3.00 
■3.00 
3.00 
3.18 

2.82/' 



All Schools 



49. 



6 (12^) 7 (14%) 28 (57%) 5 (10%) 3 (6%) 

h 



2.84 
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TABLE LXXVIII 

WIS-SIM'S EFFECT~ON YlEE-TING INDIVIDUAL .STUDENT NEEDS 



School 


N * 


Much Higner Quality Much Lower Quality 


Mean 


1 / 2 3 4 5 


Mc Far land 
Jackson 
* Plover-Whiting* 
Barstow 
Northview 
, Th'oreau 


11 
8 

^ 12 
11 


^ ^ 2 2 , 

1 ■ 1 " ■ . 3 1 
'8 

^ , 6 3 1 
3 -6 2 


-"J-^91' 

3.50 
^3.00 
3.25 
' 1.91 


' : 

1 

All Schools 




8 (15%) 15 (29%) 20 (38%) 7 (13%) 2 (4%) 


2.61 


•TABLE LXXVIX 
WIS-SIM'S EFFECT OU STUpENT ACHIEVEMENT 




/. School 


N 


Much Higher Quality Much Lower Quality 




1 2 3 4 .5 


Mean 


McFarland 
Jackson 

Plover-Whiting 
Barstow 
, Northview 
Thoreau > 


11 
4 
6 
8 
12 
11 


4 5 1 1 ■ 
• • 2 2 

U 13 1 
■ 8 . , 
2 ' 6 '3 
1.4 "6 


1 


1.91 
. 2.50 
3.50 
3.00" 
3.25 
2.45 


All Schools 


52 


6 (12%) 13 (25%) 24 (46%) 7 (13%) 2 (4%) 


2.73 
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TABLE LXXX 

WiS-SIM'S EFFECT ON QUALITY OF INFORMATION 



School 


. N 


Much Highe,r Quality Much Less Quality . 


) 

Trtean 


1 2 3 4 5 . 


McFarland , 
Jackson 

Plover-Whiting 
Barstow 
Northvi'fejii; 
.Thore-au j 


V 

- 11 

■4 
6 

- 8 
12 
11 . 


4 1 ' 
•4 

1:4 1 / 

8' 

,.lv-9 1" l' 
' 3 ' 8 


2.64 
3.00 
3.00 
3.0Q 
3.17 
2.75 


All Sclj'ools 


52 


^1 (2%) 8 (15%) 40 (77%) 1^(2%) 2 (4%) 


2.90 



/ 
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TABLE LXXXI 
MEAN* RATINGS OVER ALL RESPONDENTS AND ON 



ALL ITEMS OF SECTION A: ATTITUDES TOW^ WIS-'SIM 



1 (a) 
(b) N 

' (c) 



(a)" 
(b) 



160/52 = 3.08 
169/52 =• 3.25 



(a) 




8/52 = 2.^5 



53 .= 4.38 



(b) 164/5^= 3.09 
156/50 ^/3.12 

(a) 141/50 = 2.82 

(b) 139/49 =-2.84 

(c) 136/52 -= 2.61 

(d) 142/52 =2.73 
151/52 = 2.90 



r 



Responsiveness to Needs for Information, Management 

istructional 



U& J.UL JLllJ 

ds fdriLns 



Responsiveness to Need 
Decision Making 



Responsiveness to 'Needs for Instructional, 
Planning 

t 

Amount of Time Spent in Instructional Planning 
Quality of Decisions of Instructional Pl^^ning 
Replaced Teacher as Instructional Decision Makerjs^ 
Helpfulness o^* WIS^SIM Overall 

Proportion of Time Spent Teaching ! 
Comprehens^iveness of Instructional Program 
Sequencing Skills of Instructional ProgAms 

\ I 

Meeting Individual Student Needs 
Student Achievement • ^ 
Quality^ of Information 
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> 

The variatxpn in school responses should also be noted. 
McFarland, the system's 'largest user, is consistently the. most positive 
aT>out the usefulness and effects of the system. Barstow, essentially 
a non-user of the system, is least positive, having not- a single 
rating less than 3.0 and several. at 5.0. Thoreau had the second 
most positiye ratings, on the a^rage, and they were the system's 
second largest user nean the end\^f the 1975-76 school year. 



an the 

Positive resDfzTnse appear^ to be dJhre.ctly related to frequent use. 

Given/xhat McFarland was the most frequent and most ^stable user* 
of the system over the 1975-76 pilot test year, an analysitflbf their 
responses would' seem appropriate. All of McFafland's responses, 
excepi[r for the item concerning the replacement of the teacher as the 
dec^ion maker were less than 3.0. Seven^of their responses averaged 
2./0 or less and the remaining four were" between 2.0 and 3s,0. 
McFarland teachers were most positive about the effects* of WIS-SIM 
on the quality of instriictional decision making for instructional 
planning and grouping, overall helpfulness, responsiveness to needs 
for instructional decision making, responsiveness to needs for 
instructional planning, effect on meeting individiial student needs, 
and etfect on- student achievement. This yser school reflect^s a very 
positive picture of the usefulness and effects of WIS-SIM in the 
primary areas the system w^s designed to impact. 

f ^ 
Eigh^ suggestions X'erd received fromusersK: one from Thoreau, 
one from Northview, ai)d six from the McFarland schools. The' main ^ 

red m^i/sing other 
useful when 



recurring suggestion from the three schools refer 
bas^ for -grouping. ^Some ,data suggested as bein 
forming groups included: • / * ^ 

^ 1. Pretest scores , 

2. Learning-style information 

3. Rates of learning. * ^ " 

Other suggestions included: (1) changing the skill prerequisites aO' 
sdme levels (program not mentichied); (2) improving WIS-SIM' s 
capability for reporting to parents; (3) inclusion in the student 
data base of other data such as number of reading books read', music 
marks, and, art marks. » ' 

^ ! 

The results indicate that positive attitudes vary directly 
with frequency of use. Schools, that use the system tend to have 
more ^positive attitudi^s. It should not be inferred that use causes 
positive attitudes, however, because many factors- may affeet both 
use and at&itudes. Attitudes may very well affect use. Overall 
attitudes were somewhat positive in several of the areas expected. 
Attitudes of high use schools were positive in most, and at 
McFarland in all, areas anticipated. It is concluded that, in 
schools where the system is used frequently, teachers perceive it as 
having the anticipated effects on decision making and educational 
outcomes. ^' 
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V 

SUMMARY "and CONCLUSIONS 

. • \ 



The Wisconsin System for Instructional Management (WIS-SIM) 
is a computer-based management:, information system designed to assist 
teachers with the instructional management functions as well as" 
provide the requisite record keeping and clerical tasks involv-ed when 
^instruction is individualized. WIS-SIM is not a curricular program, 
ate programs within computeiAassisted instruction (CAI), but has as 
objectives t?he collecting arnd processing of stucTent information, 
and\upplying this information at appropriate times and place^ sp 
that i^^s directly applicable for instructional decision maW'ing. 
When theN^^ropri'ate information is supplied to instructional decision 
makers in ^^Nisable format, efficiency and quality of dec^ion malting 
improves. Teachers, students, and adhiinistrators continuously need 
information through which they can evaluate instructional decision 
making.^ ^ ^ 

The aims of computer managed instruction (CMI) concepts and 
practices go beyond traditional student accounting. This results 
from the growing evidence that indicates* the strength of a management 
information system* lies in its helping school systems adapt th^ir 
instructional programs 'to meet individual needs while maintaining * 
necessa®^ conti;ol.. It is, then, the purpose of a CMI system to''^ 
optimiz^the learning environment and, to maximize the educational 
progress for each child, while making efficient use of school 
resources: human, financial , ^and jnaterial. The system is designed 
so that it' becomes a human and machine interaction, focused upon 
individualized instruction. ' , - - ' 

The purpose 'of this report is to evaluate the results 'o)E a 
two-year pilot test of WIS^-SIM. This ^evaluation is primarily 
formative, i.e., it'is directed toward the collection of informatioji 
useful in improving"^ the design and implementationX of the system, 
rather than in nvaklng final judgements abouf its wirth. In a 
broader sense, this evaluation provi.<ies a test of proof of. concept, 
that i^ an assessment of whether or not it is possibJ.e toMesign a 
CMI j^stem capable of supporting -information and decision processes 
of ' individualized programs of ;Lnstruction, such as Individually 
Guided Education. 
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The six primary design goals that guided the daafelopment of^ 
WIS-SIM are: * ' • * -\ 

1. To facilitate the learning environment foi: each child in 
- terms of the instructional and organizational requirements 

of IGE. ^ ' ■ ■ t 

2. To ptovide information that ^ useful to educatUorfal' ' 
decision makers -at the unit, school, and district levels. 

3. To improve communications with parents and Upgrade the ^ 
quality of reporting to them about student achievement. : / 

4. To make minimal demands on teachers to^ learn the system. ^ ' 

5. To make minimal demands on teachers to pefform tasks t^hat 
are different 'from normal classroom activities and, whe^e 
possible, to recjuce the paper work requirements of school' 
personnel . A 

• .. ' • ■ ^ 

J 6, To m^ke computer management of instruction available to a 
large number of iGE schools. 

A framework, for the evaluatidh of management information ^ 
systems was developed it contains two major "dimensions of three . , 

levels each. The diipension of formative, evaluation processes: 
functioning, utilization, and effects; and the dimension of infoirmation 
type: act^ial, perceptual and judgemental. Together, these two 
dimensions form a nine-cell matrix within which th^ information ^ 
collected in this formative assessment of WIS-SIM may be placed. 
The report w^s organized according to the three~-f-^rmative evaluation 
processes'. Functioning focuses on whether fih'e various components of . 
the mana'gement information ^stem, both human and physical, are , - 

capable of operating in accordance with design expectations. ' 
Utilization is concerned with those management processes with which 
the system is being employed and whether these processes ar# consistent 
with those identified in the system design. ^ Effects are tltose 
results achieved from utilization of -the system. >-In this se'ctioft, 
the e^ctent to which* the OB^ectives of the system are being 
atta,ined is examined. 

\ • 

Seven schools ^located in fbuj Wisconsin school districts ' 
^participated in the pilot test^^All seven bf tijese schools participated "^^^ 
during the^first year of- the/sfudy , and three o£^ those schools 
continued particioation dur/ng the second year. «The pilot test , ^ 
period began in AOgust , .1975 , and ended in June , ' ],977'. *^The 
participating sc)*bols varied widely in' size and structure, from^the * , 
small Barstow Elementary ^School in Waukesha with 136 studentfte, to 
•Thoreau S'chool in Milwaukee with 650 Students. The McFarland Schools, 
McFarland Elementary Sc/ool and Elvehjem" Schopl, l<^cated next to each 
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^ther, operated "^many respects as a single school with 700 students. 
' McFarland was the first school brought up on WIS-SIM and was ^he 
• largest user of the system over the pilot test period, using it in 

support of thrfee curricula: Developing Jiiithematical Process^es (DMPte 
^ the Wisconsin Design for Readin^kill Development (WDRSD) ^ and » 

Science. . .A Process Approach (SAPA).' ^' " , ' , ' 

The schools participating in the pilot test used different 
organizational' arrangements. • McFarland had a full-time project 
director for WIS-SIM, supported through a supplem^ntaT. ESEA Title 
III grant. Thoreau used a reading coordinator at' th^ school to 
supervise the implementation of WIS-SIM. The other schoolsMiid not 

, , ^ ^ specifically designat^^ person to coordinate WIS-SIM,** and the 

principal assumed the$.e additional responsibilities. All schools 
identified aides^o operate the. computet terminal. 'In some cases*, 
these aides >were assigned other responsibilities in the school j 
in other cases, wprk with WIS-^M was their only responsibility. 
Barstow did not have a computer terminai located^in the school, 
but shared oyie with neighboring Not\thview Sphool: Jackson'^and . 
Plover-Whiting shared a terminal for one-half year, until ^ termin^j^ 
was also located in JacksoiV^School The McFarland Schools shared a 

\ terminal for Tn6st of the pilot test period, but in ,>Iarch 1977, second" 

terminal w^s added to ease the load on the first one.' 

Prior to proceeding to a i;evie^ ^^he* findings in the sections 
on functioning, utilization, and^ effects , a discussion of t^ie. 
reasons for several schools not 'participating in the second' year 
of the pilot test is included. 

Schools Not Participating in the Second Year of the Pilot Test , * . 

Waukes-ha . As mentioned", during the two-year pilot test; seven 
Wisconsin schools in four' Wisconsin school districts were ^included 
in thp study. Only two of those schools, in c^ly one schobl 
district, continued for the duration' af the pilot test; another,- 
thoreau School in Milwaukee, was added mid-first year and continued 
' for the remainder of the pilot test. It might be added that all three 
^ ' these schools will continue to utilize' WI^-SIM fortlie 197^-78 , . 

school year, four schools, however, were using WIS-SIM in 197.5-76, V^^ 
^ .but did not cont-iuue through the second year of the pilot test," — 

^ > these being -the schools in Waukesha and Stevens Point. All fdur 

' ^ schools were not continued by mutual agreement and , in the case of 

the Stevens Point Schools, redu(^^tiqns^in both the project's budget 
and the district's CMI budget was. a major , reason. This evalaation . 
of WIS-SIM would be incomplete without some reference, to the schools^ 
that did not continue. Interviews were i:onducted with- the staff of 
all these schools before and after the decision was made to -terminate , 
in an attempt to identify factors ' that ^may have been, associated with 
the decision.^ ' • . ^ ^ 
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The two, schools in Waukesha are locatedVin close pretximity to 
each other, within two miles. One school, Bar^tow, jwas q^uite small* 
and the other, Northview, was of^edium size wrth A53 students. 
These two schools shared a terminal located in Northview Elementary 
School. The invitation .to include these schools Vi the pilot test 
was initiated through a district-level ' supervisor \^ the principals. 
A. district-wide meeting "Iwa^ held with elefifentary principals, iu 
order to describe WIS-SIM-and- ask f or voluiTteer schools, Li£tle 
1 direct contact waa made with teachers prior to the principals' 
decision to participate and, consequently, the school stafv^f^ lacked 
an understanding and commitment to the study. Mos^ teach'^ers ^in the 



Waukesha S^io^s never appeared to trust the system to ^a point, 
where they felt they could dispense with their manual record system; 
consequently, they saw the system as making .more, ratTier, than less, 
work for them. 

A|: tftie same time as the pilot test was proceeding, the two 
Waukesha Schools were implementing a commercial form of the DMP 
curriculum. Materials ^or this program 'did not arrive on time and the 
math program could not bfe-^operly impleiag^ed in the IGE for/fiat. 
Two conditions affecting the success of WIS^-^M occurred. Fltst, 
a reverse hal'o effect occurred-; WIS-SIM was linked with* the negative 
feeling toward the DMP curriculum- and the problems with its imple- 
mentation. Second, sinc^ the cirriculum could not be progerly 
implemented V that is, grouping could wot or did not , take place, the 
management system was not seen as essential to the teachers* needs. 
Little or no use was made of the DMP system by Waukesha teachers, 
especially at Barstow School, during the. year of the pilot test in 
which they participated. The size of* Barstow School may, itself, 
have been a factor in its disuse of WIS-SIM. Since it was a very , 
small school,^ its management problems may not have been as pressing ^ 
as those of larger schools . 

No one in the Waukesha Schools, at the school level, toolc 
responsibility for implementing WIS-SIM. While the principal was 
knowledgeable about the system, having\been the»primary point of 
contact and having completed the inservice .Course , he was not 
knowledgeable enough to deal with the many teacher questions apd 
concerns, and lacked an enthusiasm for the system. In any event, 
he did. not have sufficient time to devote to the implementation 
of WIS-SIM. Additionally, the R & D Center did not provide sufficient 
^support to these schools during the early^ part of the pilot test. 
The development of new systems and training materials and the support 
of a large number of schools in pi^portion to project staff size 
led' to minimal field support for these schools. Finally; the 
cpm^uter-terminal aide in Waukesha ^was not alToc^ted any fixed time 
for work at the terminal. The aide's time was shared . between this 
responsibility ^ind other classroom responsibilities. Teachers 
wanted 't^e aide t^o « spend time on cla.sstoom respopsibilities at 
the 'cdst of less time sp'ent in work on the terminal. 
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. Th^sc factors, then, are believed to hav.e affected the defoision 
ol the Waukesha Schools to terminate their^ participation in the 
pildt test at the end of the first ^ar: lack of complete under- 
standing and commitmer)t on the p^rt o.f 'teachers; concurrent problems 
with the implement.at'ion-e^a^jT^w curriculum which was to be supported 
by/WIS-SIM; ,not fplloying tij^instructional model around which the_ 
system was designed; /s^aringay:omputer -terminal; lack of a- 
coordinator at the SQh|t)ol l^yeiNfor the ' ijpplementation of the system; 
inadequate field support from th^ft^/^D Center; conflict in the 
allocation of aiders time for computer-terminal ' operation ; and, in 
the case* of Ba^stow School, restricted accesf to the shared computer 
terminal as well as the small size of the school. 

Stevens Point . The Stevens Point schools entered the pilot 
test early in the 1975-76- school year*. Teacher dnd principal 
consent. was secure.d prjior to their agreement to participate, and 
they were enthusiastic about the potential of the system. A- single 
terminal was loca'ted in the Plover-Whiting School , ^-wh ich was to 

used by both schools. Since the distance between the two schools 
was several miles, Jackson School d^d not make frequent use of the 
sys'tem. A terminal was added in the. Jackson School about mid-first ^ 
year and their usage increased greatly. The computerTte'rminal aides 
in Stevens Point were' quite gbod, felt at ease with their work, and 
were allocated Lime for it. No coordinator for WIS-SIM, other thafi 
the principal, was present in either school. Some early concerns 
were raised by teachers about errors in the student dat^^Base. These 
erjrors^resulted from improper coding of past student achievement 
information by teachers, which may in turn have been a result of 
inadequate instructions during the training sessit)ns. Field support 
was also insufficient for these schools. Still, at the end of the 
first pilot test year', both Plover-Whiting and Jackson appeared to' 
be, and were, successful users of the systenj. 

The second year was a different story. The experienced aides 
had left; no one was coordinating the imple^ientation at the school 
levels the data bases nepii«^to be updated', a teacher , strike was 
looming; and a date for an inservice^ould not be agreed upon. Also, 
it was becoming clear to the R&D Center that the project's budget 
would not support the continuatlbn of all pilot tes"? schools, 
Additionally, the future of the project wa^ uncertain. As time went 
on, the situation worsened. No inservice was held. The R&D 
Center did not want to ehcourege Steven|j Point's participation, 
only to possibly have to «;ithdraw support in a month or two; so 
nothing was done. Jhe Stevens Point Schools continued to have the 
terminals available, but made "kittle or no use of thenf during the 
second pilot test year. They were, as it turned out, non-participants 
in the pilot test during that year. 

The major f/actors associated with non-participation in the second 
year of the pilot test in the Stevens Point schpols 'were : departure 
of knowledgeable computer-terminal aides; lack of school-level 
coordination; ikck of field support from the R&D Cent-er, resulting 
from uncertainty in budget; failure to hold an inservice; and^ 
instability in/the school district leading to a strike by teachers. 

/ 213 '' 
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SUMMARY OF THE FINDINGS 



THc evidence collected 'a part of this two-year pilot study 
has been reported in detail in Chapters II, III, and IV of this 
report. These discussions are suimnarize'd in the following sections 
on system functiqning, utilization, .and effects. 



"^ System Functioning 



System functioning is concerned with' the^c^pabil ities of both 
the human and physical elements of the system and't;heir ability to 
perform in accordance with design expectati,ons. In order to train ^ 
and to assess whether or not system users were knoiiledgeable ^^out 
and able to use the system, inservice sessions were held. The . ^ 
inservice program held in the fall of 1975 was .comprehensive a^ 
lasted for about three hours. The sessions held ^.n the fall ot 1976 
were'much shorter ,• since participating schools had completed at 
least a year of prior use. The 1976 sessions were'ref resher courses. 

Inservice results far 1975 were successful in changing 
participants* knowledge about and underst^anding of WIS-SIM. Scores, 
6n the average, increased about four points or 20 percent to a mean ^ 
score of about 17 out of 20. These differences between the 
pretest and posttest.are statistically significant. Respondents' *^ 
attitudes toward CMI and its usefulness were .generally positive 
pre- inservice and were significantly more positive following the 
inservice. Inservice sessions for the aides operating the computer 
terminals were also held, although some aides did not have supervised 
training on the terminal. Aides receiving supervised training , 
successfully completed a checklist designed to assess^ their ability 
to operate the terminal^and carry out WIS-SIM operations. •* 

Attitudes toward the iqservice wftre positive as well. \ 
Participants' generally felt that the sessions were useful and emphasized 
Important points. Some additional emphdsis might hav6 been placed 
on requesting and interpreting reports and less time spent in the 
work sessions on school data. 

\ 

* The 1976 inservicexwas' assessed only in terms of* general 
attitudes toward CMI at the end of the sessions. These assessments » - 
proved to be quite' positive , as they were th^ previous y|^. 

Testing of system software 'components was conducted by project 
staff as they were finalized, and a test of the complete system 
was c-oAducted prior t6 implementation in the schools. A year-long ^ 
developmental tryout ^a*s conducted in four schools during the 1974-75 
school year, resulting in system design chajogfes and improvements 
prior to the beginning of the two-year pilot test. 
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TKe ability of thp ^system <:o respond to users' need for informa- ' 
tion within a reasonable time was also examijied." Turn-around ' 
requirements wer.e determined to be typically overnight!, occasionally 
within a ^ew hours-, and l^rely within an hour..' WIS-SIM was designed, 
howevej;^; capable or responding to all request^ within on^-half 

hour. Turn-around t^iihe was defined as the time between the enter ^.ng 
of a reqc^st at tjj^^terminal and^the receipt of "the reptfft back^at . 
the t^rminair-*— -No assessment » was made of the processirig of, th^^tequest 
at the school level between the teacher and the computer^terminal 
aide, n^ of the return of the report from the terminal aide to 
the requesting^ .teacher. In l976\ ' turn-around times averaged 21.7 
and 69.3 mi^ut^es for DMP/SAPA and WDRSD, respectively. In 1977,^ 
these times v<ere reduced to 18. A and 13.8 minutes, respectively.' 
The latter "years ' results w6>^e within the specified thirty-minute 
criteria. ^ ^ ' , 

^ ^ The functioning of the system in the areas investigated appears 
to be according to design expectations. 'Still, there are ar^^s of 
needed improvement and these will be addres'sed in a later section 
on recommendations.. 



System Utilization ^ . " ? 

.The^system utilization dimension of tjie evaluat ion 4^ign ^ 
relates to the management processes fdr'x#fiich the system is being 
employed and the consistency of those processes with those, identified 
in the system design/ TKe dimen^ic^ of WIS-SIM utilization was 
evaluated by addressing the following issues:- « 

1. f Actual level: . <? . 

a. Number and type' of system Vccesses^ • ^ 

2. Perceptual leveJL: ' « 

a. IJsag^of reports. ^ . 

b. Appyropriateness of' reports. 

c. ^ Usefulness of \^^^ts/ ' ' • 

d. Schoql t'asks supported by WlS-SlM.' ' » ' ^ 
? • . ' ' 

N-umber and type of system accesses by WIS-SIM" users were estiinat;ed , 
"by tabulatidn of system logs during select ed' periods . ^ The McFalrland 
Schools were, by far, the most frequent users of the system,* averag- r 
ing 74.0 accesses per wfeek in*1975-76 knd 124.^^5 accesses per week, 
in 1976-77. Most o^the accesses *by all u^ers were for the purpose 
of grading. Th6 otheY most frequently used/WIS^-SI>l f unctions'Wng ' 
the Individual Perft>rmance Profiles^ (IPP/s) and Instructional 
Grouping Recoiranandations (IGR*s). 
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Unit leaders, teachers, and aides In each of the user schools 
were surveyed to determine what uses were being made of WISr-SIM 
reports. The majority of respondents did, not indicate uses of 
reports other than* those for which the reports were designed. 
However, many'.of the uses reported represented creative, additional 
applications. 

Respondents rated the WIS-SIM reports quite higVi'wlth respect 
to appropriateness. The only exception to this high rating was the 
Prerequisite Deficiency Report (PDR) . Suggestions for modification 
of ,reports were also obtained and will be considered in future 
revisions and updates of the system. . - ' 

The WIS-SIM users ""also evaluated the usefulness of the reports 
or, more specifically, the'usefulness of the information contained ' 
in the reports when making decisions about the instruction of 
students. The respondents ^consistently rated the reports quite high 
with regard to -usefulness. The consistency of the ratings obtained • 
in 1977, with those obtained in 1976 appears 'to indicate an on-going 
satisfaction with the reports. 

The utilization of \^S-SIM is assumed to affect certain tasks 
in the school. U^ers were surveyed to identify thdse task^ supported 
by the CMI system. ^ The questionnaire administered contained twenty- 
seven tasks typical for IGE schools^ for which the respo'ndeifts 
indicated whether t,heir role or responsibilities had changed because 
of WIS-SIM. 

. Proportionately few respondents reported the perception that 
the usage of WIS-SIM had completely replaced a manual task or proy 
cedure. Likewise, few tasks were considered extra because of 
•WIS-SIM. Tasks considered most affected by WISnSIM included: 

1. Idetitifying individual student instructional needs. 

2. Maintaining individual performance profileis. 

3. Grouping studentte for^ instructional purposes. 

The tasks in which' the users considered their role to be changed 
included: , V » 

1. Maintaining individual performance prqfiles. 

2. ^Maintaining unit performance profiles. 

Jt'-is of interest and significance that perception of role change or 
re^iponfiibility change as a result of WIS-SIM appears to closely 
parallel the perception of tasks affected by WIS-SIM. 
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' The system effects dimension of the evaluation design addresses 
the question of the results achieved from utilization of the system . 
and the extent .to which objectives of the system are being achieved. 
The five issues discussed as system effects are: 

1, Actual level: 

a. Teacher time usage, . ^ . 

* b. Student achievement, 
c. System costs,. " ~" - -r- 

2, Perceptual level : 

^anr Change in school ope^rations, 

3, Judgemental level: 

a. Desirability of system effects. 

The data related to the allocation of time to the areas of 
planning, instruction, and clerical tasks appear to indXo^te a 
reduction of amount- or percent of time required for cleritTal tasks. 
Subjective- comments by the teachers tend to confirm this 
c^onclusion. However, due to a large variance in th^e data, statistically 
significant findings cannot be reported. Subjective teacher comments 
regarding planning time indicate that; although* the actual hours 
involved have not changed appreciably, the planning prbcess is ' ^ 

more ^effec'hive and more Us accomplished during the time, 

f » 

Student achievement subsequent ^to the, implementation and use 
6i WIS-SIM at the McFarland Schaols can be shown to exhibit a 
positive trend. As discussed in the section dealing wit;h this topic, 
achievement effects must be interpreted with some caution, as they 
are subject to 'the influence of a large number of factors in the * 
school environment. 

The cost of WIS-SIM may vary widely depending -on factors such v 
as level of usage, curricular areas supported by the system, conmuter 
services costs, staff development, [hardware used, and personnel?'^ 
An illustrative example of WISySIM cost may be drawn from Table XVIII. 
Support for 700 students for WDRSD using a normal turn-around mode 
on a Univac 1110 computer would cost approximately $.80 per student 
per mottth, or about $5600 total cost per year* It should be noted ^ 
that the cost-^or instructional support may not increase by ,this 
total amount in^ that the management system originally used would 
have been replaced, * *^ 
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Computer managed instruction is not prohibitively expensive 
ior all school systems, especially^ those having access to an appro^ , 
priate computer facility/ It probably^would not be cost-effective 
for all .schools, however, depending on the size of the school, 
its organizational structure, and the degree o.f its IGE implementation, 
Cost-effectiveness of WIS-SIM rests on its potential as a management 
instrument, not as a record keeping device. 

With the exception of some increase in the frequency of meetings 
and consul tat i#ons between teachfera and staff closely associated, 
with actual system usage, there appear to have been few changes 
ih school operations. Any significant changes that do occur are 
likely to tak'^^lace early in the implementation phase. 

Teach,ers and administrators indicate quite positive attitudes 
toward the cfesirability of WIS-SIM effects. This is supported by' 
the objective rating analysis as >7e-ll as by the more subjective 
teacher^ interviews . A number of *£eachers have become so emphatic in 
their support of WIS-SIM that they indicate tHe feeling- that a true 
IGE instructional environment cannot function properly without 
the .system. ' „ - - 



SITE SELECTION 



' The criteria for selection of a school or school district in 
which to implement WCS-SIM are not defined explicitly by the results 
f this evaluation. There are, however, several areas to swhich the 
ndings do indicate ^attention should be given. Although these 
arWs may not contribute individually to the success or failure of 
implementation, collectively they may be important determinants, 

e" decision on'the part of the teachers to utilize CMI, 
rather^han its implementation being imposed on them, appears to 
be an important consideration. The sites at which WIS-SIM has been 
most successful are those at which the teachers, themselves, . 
perdeived a need -for assistance in the requisite record keeping and 
decision nicking associated with individualized schooling. When this 
*teed is not perceived first, the "implententation of CMI pay be viewed 
as additional work or' another timer*consuming procedure, 

Sinc^ WIS-SIM was originally conceived to be a support systfem 
for the management functions associated with individualized school- 
ing,- the site should have an organizational structure similar in 
some respects to the IGE model. The real i5otential and value of ^ 
WJS-SIM ife i^s ability to erjhance- decision , making and not simply 
reduce clerical and record keeping tasks. If the latter a^re viewed 
as its primary funct'ion, the likelihood of success is reduced. 
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The size of the school is, clearly, an^ important aspect to 
consider. Although.it is* not possible at this time to offeV rigid 
guidelines or parameters, the 'evaluation would appear to indicate 
that a school with a minimum of about 400 students woulcl be a , 
reasonable inside parameter. )^ small school will not possess the 
record keeping or instructional decision requit;^ments • that require 
computer support. 

Closely related to the -Concern o'^ teacher support is that of 
administrative support. It is unlikely that an unsupportive 
administration would provide "an environment for a successful * 
implementation, even though the faculty may perceive a strojig need 
for the system. On-going success requires appropriate allocation of 
personnel ,* e.g. , terminal operators, attention to problems that 
may arise, and time allocation .-to staff training, e.g., inservice. 
These are functions within T^he administrative domain over which 
teacherg may have no control. 

The availability of the required computer .hardware and software 
*is an obvious requirement in site selection. Presently, the WIS-SIM 
is operable only on computer sy-etems such as the UNIVAC 1110. The 
conversion to other systems is possible, but may require considerable 
time^d expense. Future WIS-SIM efforts yiH focus on the develop- 
ment of microprocessor hardware and software, hopefully Eliminating 
this constraint, but this is presently unavailable. 

For reasons discussed inNnore detail in Chapter IV, costs and 
budgetary considerations are dirficult. to address. Also, these 
requirements *are in a constant state of flux becau'se of" evolving 
tec/hnology. Since the associated costs* will be unique for different^ 
sites, close attention should be given to the district's ability 
to meet the expenses associated wj.th the system including actual 
computer costs ,' personnel , consultive support, training, and on- 
going maintenance. * 

It should be apparent thafit is d.^fficult, i5 not impossible, 
to generate a profile by which one may determine an appropriate site 
for WIS-SXM implementation. This evaluation, however, dpes indicate 
that the .areas summarized below should be given careful consideration 

1. Perceived need on the part of the J:£_acher' f oi^ computer 
support for instructional management ,^ decision making, and 

♦ record keeping. 

2. ' Support by administration within the school as well as in 

the central office. 

\ ' y ^ • . 

/ ' <■ • , * 

\ ■ - 

3. Instructional and organizational structure -consistent with 
• the system design objectives. 
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4. Availability of computer^har<^ware and software 



5. Adequate fundfing. 



School size /sufficient to require computer support, 



STAFFING AND IiNSERVLCE 



/ 



The introductibn of a computer -rsupported system such as WiS-SIM 



may represent a tot/ally new exp^f^T^nce', to the faculty and sta-ff of 
school. Associated with the introduction of the system, there may 
be evidenced behavioral characteristics such as apprehension and 
anxiety about the/system; varying levels 'of 'con'Tidence and 
perceptions of itfe usefulness, and a general lack, of understanding. ' 
Therefore, the importance of staff preparation^cannot bie understated." 

' ' / 

Closely, akin to this need for staff development j(*S.s the need for 
a facilitator or coordinator. A s'C^f member'who is given the time 
and training to be an active resource person can be extremely 
functional* and is, possibly, essential. The evaluation appears to 
indicate that the most successful implementation sites have 
designated suc/h a person to be responsible for coordinating the 
CMI efforts.' / This coordination .may include overall supervision of 
CMI activities, trouble-shooting, planning and evaluation, and 
acting as a iiason between the school and the consultive support 
^personnel, '/The evaluation also indicates that the principal may 
not be the person best suited for this position because of his or 
her time olyligations in performing necevssa/]^, existing functions. 

The uotal inservice and staff develofiment program should be - 
carefully /planned and executed. This progf^ should include two 
dimensioiys — one focused on the needs of the computer-terminal operator 
and the other on the needs of the teachers' and classroom aides. 
The terminal operator . must- feel completely comfortable with the 
processes associated with communicating with the computer. ^ The 
teacher/s* must understand the design concepts of the system as they 
relate/to instructional management and record keeping procedures. 
An eff/ective program should, therefore, develop in addition to 
understanding, feelings of confidence and positive user attitudes." 



'Sufficient documentation and manuals should be made available 
to tyhe staff to enhance their utilization of the system as well as 
to provide day-to-day answers to questions that may arise. As new 
documents appear , ^adequate ^ time for explanation^and discussion 
should be provided. 



In summary, a necessity for successful WIS-SIM implementation 
ci/nd i/tilization is developing an adequate understanding of the [ 
iysf:em on the part of all personnel involved. This requires a 
/caVefully planned program of staff development, both in the initial 
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Stages and in the on-going phases- of use. ,^This may be enhanced 
considerably by the designation of a coordinator responsible for the 
development and dist;ribution of materials for the facilitating 
and scheduling system activities, and 'for exercising oyerall 
^responsibility for the total CMI^program. « ^ — ^ 

SYSTEM IMPLEMENTATION. ' * ^ • ' . 

This pilot test has underscored th^ import^ce of several factors 
-%in implementing WIS-SIM. First, the esseti^i^i^value of a school-level 
c'^rdinator was identified* . This individual should be a professional 
edilcator and shduld develop an in-depth understanding of the system. 
Positive attitudes and knowledge of jsystem purposes and procedures , 
on the^part of a school-level coordinator can go far to ensure* 
effective system implementation ancj' use; this pQjrson acts as an 
ambassador for the system in the school. Careful- identification 
and training of this coordinator is essential. 

f ■ 

The trtaining of teachers and aides is^^^Jreo critical. Teachers 
who do not understand the systen\'S purposes or how to use information 
provided will not be satisfied Jsers. Since the ^reat majority of 
communication between the users/ of the system and the system data 
base? is through the aide"", the/i;itportance of this role is crucial. 
Back-up,' or cross trainl,ng, far this position is essential." 
Finally, *the training of all^ associated personnel is of vitals 
importance to ef f ective - systetn implqjnentation and utilization. 

Many s»y9tem users do nat think of themselves ag decision makers. 
A part of the users' training program should emphasize the decisions 
that teachers make and demonstrate the relationship between informatio 
de^livered by, the CMI system and teachers' decision making. Users 
should recognize the- relationship between system responsiveness and 
its relate^ costs. .Genemlly, the more responsive the system, the 
'more [costly the generation of information will be". Planning in 
^ advance' for instructional decision making can greatly reduce system 
operating cbst^. Additionally, teachers should recognize the 
difference between™hfe/informatidn they desire to make a decision - 
arrt^the information they need to make the decisiouf Teachers 
frequently request information they do not use in decision making. 

Efficient ahd prudent' use of CMI capabilities is a difficult 
matter to address, but must be in order to have a system opetable 
.withdn the typical ybperational and budg/etary constraints of most 
schools,' perhaps making the costs of system operation more visible 
to teachers. t/Quld /assist in resolving some of these concerns. 
During the period/of the pilot test, considerable misuse of lihe 
^ystem^ (over rest/pnsiveness and extraneous information) was tolerated 
to encourage sy^em use and to demonstrate sysjtem capabilities. 

7 « \ 

Users of trne system will not perceive the system to be >iseful 
unless it siippprts decisions actually made by teachers at that 
school. The instructional management information system is based 
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uppn assumptions absSut the information needs in support 
ized instructional programs. As mentlbned previously, 
for site selection , the compatability of system assumpt 
designs with school information and decision needs is,e 
successful systpm implementation. 

As also pointed out in the section on site selecti 
irf the school and the school district t:an also be a cri 
in successful implementation. If the school district i' 
in major conflict, such as migjit result from court-orde 
tion or a teacher strike, the effectiveness of implemen 
likely be affected negatively. 
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FRAMEWORK FOR EVALUATION OF MANAGEMENT INFORMATION SiSTEMS 

While the prfmary concern of this report is to provide an 
investigation of the implementation of a system of compute'r managed 
instruction, it also provides a vehicle for the^design and testing 
of An evaluation framework to*be usei in carrying out this investiga- 
tion. With the rapid expansion of information technology in education, 
as in other fields, designs and procedures for the evaluation of 
management information systems are seen as critically important. 
This is jparticularly true when one considers the cost of developing 
and -operating such systems. ^ > 

The framework used in this study consists ^of a nine-celled 
matrix created^y considering three types of information and threa 
aspects of information system implementation. The .evaluation was 
•seen as .primarily formative, in that its' objective w^s to provide 
information useful in improving the design of the system, rather than 
•to make summative judgements about its worth., Although some judgements 
can be made about , system value and effects, the design utilized*^ is * 
not capable of providing a strong link between system implementation 
and the effects noted. Such summative assessments are seen as 
desirable, but difficult to make in light of the complexity of most 
^nanagement information systems, their evolutionary nature, and time 
constraints. Information systems must respond to changing 4ecision 
and information needs in the systei^^they serve. 

As a result of the testing of the evaluation framework in this 
pilot test, some conclusions can be drawn about the evaluation of 
•management information systems. The three types of information 
collected, actual, perceptual and judgemental, provided for a more 
complete assessment^<^ tthe system than would have b^een provided if * 
fewer types were considered. While actual data may be viewed as 
preferable to perceptual data, it is not always possible to -collect 
actual data, and, additionally, the comparison of actual data with 
perceptual data affords an important check on those perceptions. 
This information may be useful in' assessing wbfether or not users 
are accurately perceiving system effects. Discrepancies between 
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actual and perceptual data may be explained in part by the attitudes 
system users have toward the system or, alternatively, these attitiides 
• may be explained by*4:hose differences. Difficulties, encountered in 
the placement of inf or>jnation elements in the categories of actual, 
perceptual and Judgemental inf ormat^piMnay suggest that these 
constructs are not a*s well-defined as they were thought to be. 
Additional effort needs to be spent on clarifying these terms. 

• The trichotomy of system functioning, utilization and effects 
also provided a useful- way of analyzing system implementation. Those 
three cat'egories are Cumulative, in that categories two and three 
are dependent up^* t;he preceding stages; that is, system utilization ' 
is dependent on system functioning, and system effects an^ dependent 
upon system utilization. Problems identified at one l^^l may be 
traced to difficulties encountered at the previous level. 

Information elements included in the framework were all useful 
in evaluating the implementation of the system. Considerable 
refinement in the specification ^nd classification of information 
elements is needed, however. The^isting of information elements 
included\in this anal^is is incomplete, and a more systematic 
format fpr delineating these elements is needed. Presumably classes 
of elements .could be generated for. each implementation* category , with 
the same elements 'repeated under tnb actual, perceptual and judgemental 
types of information. Whether or not it would be desirable or*'possible 
to collect the specified information would be a decision made when 
Considering the design for the evaluation of a particular implementa- 
tion of a management information system. • - - 

} ' • / i * 

The definition of management injbrmation system \Xb&c iq this 

study included the humans as elements of the total system; that is, 

the system was not reviewed totally as a machine system. Assess-. 

ment of th^ functioning of the human elements of the system, in a 

way analogous to the way the machine components are tested, is 

extremely importan^to understanding system operation and assessing 

system implementation. 

The evaluation framework generated for this study evolved as the 
management system, itself, evolved during the period of the pilot 
test. Had the framework been conceptualized in its present form at 
the time the evaluation was planned, there is little doubt that a 
more comprehensive and useful evaluation of the system implementation* 
would haVe taken place... This conclusion^suRgorts ^e value of this 
framework to the design of evaluations for management information^ 
systems. • . ^ • 

One problem external to the evaluation framework was the failure 
to collect adequate pre-implemenhation data and to identify suitable 
comparison schools. Unf ortunatel^^, the principal school in which 
data werfe collected dici* not have a stable, standardized testing 
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progratn and had been involved in the pilot testing of several curri 
programs and (structural) organizational changes for several years 
precyeding the implementation oi WIS-SIM.^. Additional . changes con- 
tinued during the WIS"-SIM implementation as well. In any event, 
the " inability to have pre-^implementation and comparison data greatly 
limited the' information available to assess the chailges and effects 
psociated with system implementation. 




GENERAL CONCLUSIONS 

The pilot te&t of WIS-SIM is important as a proof ^of concept, 
bat does not provide strong evidence that this system is Ci^st 
effective in improving educational outcopies. The test demonstrates" 
that a system supportive to an individual;Lzed system rof ^dufcation 
can be designed, developed and implemented successfully. Teachers 
,can be trained to use the system and these teachers describe the 
system as useful in the management of instruction. The evidence 
of system effects is based on teacher perception^ more tlfkn on 
hard ddta. The distribution of teacher's time does appear to be 
changing in the direction predicted; that is, teachers are spendirtg 
less time on clerical activities and more time on planning and 
instruction. System costs, while high -at present, are n,ot so 
extreme that it would be impossible for a school district to implement 
the system. Off-setting costs, such as reduced aide time for ^ 
performing record .keeping, need to be taken into Account when 
weighing the*costs afnd benefits of adopting the system. 



In the first chapter of this report, six WIS-SIM objectives ^ 
and six design goals were presented* On the basis of the eviclence ' 
-^presented y it fs concluded that, the six objectives have been ahhieved. 
While additional investigation is required in^ the areas of classifying 
instructional decisions and providing useful information to instruc- 
tional (^ecisi-on makers at appropriate times, this pfoject did 



have '"significant impact in these areas. 
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iiost of the six design goals have also been achieved. DesJ.gn 
goal /six has not, yet been achieyed, as the system is just now in 
the process of being implemented be'yond the original pifot test 
schools'.. The current work of the project on the use of micro- 
prbtessors for CMI support could have a significant, beneficial 
impact on*this ^goal. Evidence presented in this report suggests" 
that t'fie remaining design goals were achieved. Design goal four, 
naking minimal demands on teachers to learn the system, is an 
/impoirliant one, but the time required for teachers to learn the system 
Awell enough to use it effectively is 'substantial ; yet learning the 
system is critical to its successful implementation.. , 

'The system, as piloti^ested, may need to be scaled down, to be 
run jnore efftci ently and e.conomical ly on smallei: compuCears. S-tra^egies 
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for more cost-effective utilization of the system nefed to be explored. 
On-line report generation, for example, may not be essential or, 
if it is necessary, it would appear to be so .for only a very' small 
percentage of informatioji requests, the utilization of over-night 
report generation would reduce costs, Vith little sacrifice in - 
sys-tetn utility. Perhaps some reports can be, -produced at regular . 
intervals, rather than generating all reports in direct response to 
teacher, requests. ' * • . , . 



Further study of the implementation of instructional mana'gement 
information systems would be of considerable '^alue. Teachers 
participating in the pilQt test of WIS^IM were involved to a con- 
siderable extent in the design and refinement of the system. When 
this system is implen\ented in other schools, teachers <»in these schools 
will not have so much involvement in the system design; Information 
is neieded on strategies for effective system implementation under 
such circumstances. The importance of training these personnel 
has been emphasized, but the effects of their involveme^ijt in system 
design^on successful implementation are not known. 



/ 



It should be clear from the findings of this report that, 
although considerable progress has ?een achieved .in the application 
of computer technology to 'education, we still have much to learn. 
The tvl'o years of WIS-SIM pilot test efforts reviewed in this report, 
'however, should provide a framework and foundation for continuijag^^ 
research and development.. ^ 
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Appenglx A 

WiS-SIM INSERVICi; 
.FALL, 1975 
POST-TEST 

S 



^I. Part of a Unit Performance Trofile for DMP is reprdduced belx)w. 
Use the information in this report to^nswer the questions beloW^. 



i ' 

OfVEl^OPINO MATHEMATICAL »»ROCjESSES 

PRO 



UVIT PERFORMANCE PROriUE 
UNIT. A RfcD DEMONSTRATlION SCHOOL 



' PA;8E I 
AS OF 07«a9-75 



NAME 



ADAMS ALAN 



ANDERS^ ANDY 
BAILEY BI^IAN 



BECK BARBARA 
■ # 

\ 



1. 
2. 



TQeiC_l 
OBJECTIVE! 



12 


13 


14 






15 


in 


1 


1 2 


3 




1 2.3 






■ it 








M 


- M 


M M 


M 


M 




H 


M 


N M 


N 


N 




H 


H , 


M M 


H 


H 






N 


H M 


M 


H 




/ 










« 



How many students ^have mastered Topic 14, Objective ' 1? 
What \^as Andy Anderson s lattest rating on Topic 15, 
•Objective 3? , ' ' , - 
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II* Part of an Individual Perfc^mance Profile for WDRSD is reproduced 
below. Use the information in this report to answer the questions below* 



WISCONSIN' DESIGN FOR REAQINO SKILL DEVEO-OPMENT 



INDIVIDUAL PERFORMANCE PROFILE 
UNIT A R&.0 DEMONSTRATION' S,CHOOL 

STUDENT NAME X SCHMIDT f SUSAN 
STUDENT N0» t 9000 

AREA i WORD ATTACK 

SKILL 

\ 

A-Ol RHYMING WOROS^ 

A-02 RHY^h^NG PHRASES 

. A-03^ SHAPES 

A^04 LETTERS, NUMBERS 

A-^05 WORDS f PHRASES . 

A*06 COLORS 

Am07 Initial consonants 

0 



ATTEMPTS 
3 



PAGE 1 
AS OF 05-27-75 



LAST SCORE 

47 

M 

M 

M 

M 

M 

M* 



DATE 

02^01-75 
08-01-74 
08-0l^»74 
08-01-74 
08-01-74 
08-01-74 
12-01-74 



1. When was Susan Schmidt last assessed on Level A,^ 
Skill 2? . ^ ' < 

2. fiow many Level A skills has Susan Schmidt* mastered? 



z 
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III. Part of an Instructional Grouping Recommendation-Group 
ceport for DMP is reproduced below. Use the information in 
this report to answer the questiohs below. 



OEVtUOPINO MATHEMATICAL' PROCESSES 

nSTRUCTIONAL GROUPING RECOMMENDATION GROUP )pAGE I 

UNIT A R&D DEMONSTRATION SCHOOL AS OF 08^2 !-7b 

TOPIC 23 t ORDER SENTENCES 

PREREQUISITE « W OR P RATING ON OBJECTIVES I THRU 5 Oh TOPIC 

2!. HOR ACTIVITIES 23C AND 23F, M OR P RATING 
ON OBJECTIVES OH TOPIC 22. 

INDEX* NAME OBJECTIVE* I 

1 *l CHRISTENSEN CHRIS P 

2 GOLDSTEIN GINA/- \ M 

3 HURbARD HOPE 

'4 KOCH KE*NNETH / \ N 

5 KRUEGER KEVIN J p 

« 

1. How many times has Kenneth Koch been assessed on the 
objectives of Topic 23? ^ 

2. What rating did Gina Goldstein receive the last time she 
was assessed on Topic 23, Objective 5? 

3. Which student has never been assessed on the objectives of 
this topic? 




2 


3 


4 


5 


ATTEMPTS 


P 


P 


N 


M ' 


9 


M 


M 


0 

P 


M 


b 










0 


M, 


N . 


N 


1 




P 


M 


N 


N 


9 
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IV. A Prerequisite Deficiency Report for DMP is reproduced below. 
Use the information in this report to answer the question below. 



DEVELOPING MATHEMATICAL PROCESSES 



PREREQUISITE- DEFICIENCY REPORT 
UNIT A RfcD DEMONSTRATION SCHOOL 

TOPIC 15 \ TWQ-DIMENSIONAL SHAPE 



PAGE I 
AS OF 07-29-75 



PRER'EOUISITE I M OR P RATING ON OBJECT^IV.E 1 OF TOPIC 8 AND 

ON OBJECTIVES 1 THRU 4 OF TOPIC lA. IF NEW 

TO DMP, RECOGNITION OF PRINTED NUMERALS LESS 

THAN AND INCLUDING 10 AND UNDERSTANDING OF 
^ SPOKEN NUMBER- V^RDSt ' 



THE FOLLOWING >UPILS ARE NOT READY FOR TOPIC 15 BECAUSE ACHIEVEMENT 
NOT ASSESSED (NA) OR INSUFFICIENT tl). NO MARKf INDICATES SUFFICIENT 
ACHIEVEMENT (N, P, OR M). 



NAME 

ANDERSON ANDY 
ELLIOTT ELWA 
FREY FRANK 
KAISER KARL 
PALMER PETER 
PUTNAM PATTY 



TOPIC! 8 

objective: i 



14 

2 2 
1 I 

f4A 



3 4 
I I 
NA I 
NA 



vNA NA NA NA 
I 



How many students have received assessments on Topic 14, 
Objec^tive 4 which are not sufficient to' meet the 



prerequisite for Topic 15? 



y 
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V. Identify the meaning of the following symbols: 

1. NM _ 

2. •' 

3. ^ TC . . • 

VI. On your answer sheet, circle the letter the one best response, 

1. * Your principal has requested a report on the achievement* 

status of students in your unit on skills in all three 

> 

areas of WDRSD. Whicji report would, you request? 
A. Unit Performance Profile 
♦ B. Individual Performany:e Profile 

C. Grouping Recommendations 

D. Prerequisite Deficiency Report 

E. Score Submission Fprm 

F. Objective Checklist Card ^ . 

2. From your DMP resource manual, you have identified 
several geometric topics. You Would like to form new 
instructional groups -to work, on these topics. Which 
report would you request? ^ 

A. Unit Performance Profile • 

B. - Individual PerfbrmanQe Profile 

C. Grouping Recommendations i * ' ' 

D. Prerequisite Deficiency Report 

c • 

£• Score Submission Form 

F. Objective* Checklist C^rd ^ / 
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3, The primary role of the computer in WIS-SIM is to: ■ 
'A. provide instruction for students in WDRSD and BMP. X 
ptocess information for instructioii^l decision-makers. 

~ <C ^ J 

C. make decisions for teachers. r - 

D. score test data. 

y 

VII • Assume that you afre Chris Jones, a teacher in Unit C at 
Abraham Lincoln Elementary School You are preparing to 
form new instructional groups in math. After studying 
your unit perfonnance profile, you decide to request 
groupings for topics 10, 12, 13, 17, 18, and 1^. Complete 
the Report Request Form attached to the answer sheet tc/ 
show this request. 



1 
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/ CllfXKLlST OF TERMINAL COMPETENCIKS TOR COMPUTKR AIDES * 

1. ^AbJllly to dial t'hc comput€n\ place telephone in nuxlem and 
/ loj; on. 

/ 

2/ Abilijiy ta read and interpret report request "forms . 

,3. Abilily to request all WIS-SIM reports in WDRSD and DMP. 

/a* Abilily to submit student achievement information through 
/ the card reader. 

/ • . 

^ Ability^to submit student ach-icvement information thrgugh the 

terminal . 

6. Ai)i!licy^o log-off the computer and tuxr/off the terminal and 



/ 

/ 



^ Name:^ 



School: 



173, 



REVIEW INSERVICE EVALUATION 
Fail, 1976 • 



The ques'tions on this page^ask for your .attitudes about using 
WIS-SIM. . There are no right (pr wrong angers to these questions. 



Very 
Favorable 



Very 
Jn favorable 



1. How are you feeling atout CMI? 



3 4 



2. Do you think' that CMI will be helpful 

to you in makiiig instructional^ decisions? 



Very. 
Helpful 



No.t at all 
Helpful 



1. 2 3 4 5 



3. In the space below, write a word, phrase or sentence that summarizes 
. the feelings that you have about CMI at this time. What suggestions 
might you have? 



J ' • 

4. Do you anticipate any problems using WIS-SIM during the coming school 
year? ' ■ ' 



4u 5. Was this one-hoar* WIS-SiM review and ins^rvice sufficient to refresh 

your knowledge of the system? 



6. Please indicate suggestions for future review inservic^s (e.g., scope 
of inservice, length of time, mat^ials, method of presentation, etc.) 

- , - / • 



* V * , 

""(If more space is needed, use the back, of this sheet.) 
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SECTION C: JSAGE OF REPORTS (To be completed by urv^Lt leaders, teachers, and aid^sj 



For each of the following forms, indicate the various uses you have made of the form and the 
frequency of these uses.^ It is assumed that forms have been used for 'their stat;.ed purposes and 
hence their uses need not be reported. The emphasis in this section is on the other uses of ' 
WIS-SIM reports made by users. Also indicate the frequency of these other uses.* 



I 


A 

I 






r 




} 

RepQrt ' 
— • « 


^ 

Purpose ' 


Other Uses 


Frequency of 
Use Per 
Semester 


Unit Performance 
Profile 


To determine the achievement 
status of students in a unit. 


o * 

f 






Individual 
Performance 
Profile ^ 


To provide achievement informa- 
tion for an individual student. 






^sage of Re 


> 

X 


Instructional 
Grouping Recom- 
mendation - 
^ Summary 


To identify students who need 
instruction in the skill 
requested . 

\ 






ports 




'f » 

' Instr-uct'ional 
Grouping 

Recommendation - ^ 
Omissions 


To identify students who- were 

not Dj^ced in any gtoup for the 

^sfcjrfls requested. ' ' 


• 




Prerequisite 

Deficiency 

Report 


To show ,the prerequis±te achievement 
status of students^ ineligible for 
a requested topici 







Please indicate any other uses who have found for WIS-SIM reports: 
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USER EVALUATION OF CMI FORMS 



Apppepriateness of the For^t of 

> 

CMI Report and Request Forms 



Rate tjie appropriateness of the format of each of the following 
forms by circling the numb^ on each scale which' you consider best 
indicates your assessment. " ■ 

As you assess each foAi, examine its format in the Teacher's Guide ^ 
For Decision Making Using a Computer Managed Instruction ^stem for IGE « 
Some aspects of format o;: design include its arrangement, spacing, size, 
inclusion of all essential data, inclusion of unessential data. 
Your assessments should focus on asjiects of ^format and not on the 
usefulness of the reports themselves in educational decision making. 
The usefulness of the reports will be' assessed at a later date. 

ONLY ASSESS FORMS WHICH YOU HAVE PREVIOUSLY USED. OTHERWISE 

LEAVE BLANK. 



Form 



.Appropr iate_ 



1 a. ^ 



In^ propri 



Unit Performance Prcff ile 
DMP * 
WDRSb 



Suggestions for Improvement 



178 



Individual Performance Profile 
DMP 
WDRSD 

Suggestions for Improvement 



Instructional Grouping Recommendation - Group 

DMP ^ ' 



• 1 

WDRSD 



Suggestions for Improvement 



' F 

Instructional Grouping Recommendation - Summary 



DMP^ 



WDRSD 



Suggestions for Improvement 



instructional Grouppg Recommendation - Omission 
DMP 

1 T 

WDRSD 



2il 



1 



Suggestions for Improvement 



179** 



Score Submission For 



WDRSD 



Suggestio 




I 



•V 



7 



DMP' Instructional Group Roster - 
Gard Inserts 



1 



^ Suggestions for Improvement 

\ 

••\) 

J 



, ^ ^ — 

DMP Objective Checklist Cards 



Suggestipns for Improvement 




DMP Grading Update Report - Group 
Suggestions for Improvement 



2 , 3 



-5 
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DMP Prerequisite Deficiency Report 



Suggestions for Improvement 



CMl Report Request Form ^ 

(N.JK Illustration in .Teacher's 
(Iiildo has been superseded) 

Student Status KeporL Form 



Suggestions for Improvement^ 



UNDERLINE ONE OF THE FOLLOWING TO INDICATE YOUR POSITION: 
ADMIlttSTRATOR ' COMPUTER A?Dfe 



TEACHER 
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SECTION B: .USEFU^ESS OF REPORTS (To be conpleted by unit leaders^ teachers, and aides) 

Rate the usefulness of the information contained in each of the following reports by circling the 
number on each scale which you coiTS^i^er best indicates your assessment. Aspects of informational 
utility include the relevance of the information • to the decisions you ^lake'^about the instruction 
of^students, the adequacy of the amount- of information, and the accuracy of the information. 

ONLY ASSESS REPORTS WHICH YOU HAVE PREVIOUSLY USED. OTHERWISE L£AVE BLANK. 



Report 



Unit Performance ' 
Profile i 



individual Performance 
Profile 



Very ^ ^ ^ ^ Not 
Usef Jl 1 2 3 A f Useful 



i 2 -i ^ I i 



1 ^ 3 I 5" 



Ir^structional ^ 
Grouping Recommendation 
Summary 



Instructional Grouping 
Recommendation - 
Omissions 



i i ^ I i 



i ^ ^ t b 



Suggestion^ for Improvement 
« — 



Prerequisite Deficiency 
Report 



i i 3 



2 4 ,^ 
i i 
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COMPUTER APPLICATIONS IN IGE EVALUATION 
1976-1977 



Included in this form are examples of the seven HIS-SIM forms: 

1. Unit Performance Prof-ile 

2. Individual Performance Profile 

3. Instructional Grouping Recommendation-Summary 

4. Instructional Grouping Recommendation-Omission 

5. Prerequisite Deficiency keport 

6. Skill Eligibility Profile 

7. Instructional Grouping Recommendation-Group 



The .purpose of this form is to assist in determining (a) the 
usefulness of WIS-SIM reports, (b) suggestions for improving the reports 
and (c) the frequency of use of each of the reports, % 

DIRECTIONS 

A. Rate the usefulness of the information contained in each of the foil 
ing reports by circling the number on each scale which'you consider 
best indicates your assessment. ^ Aspects of informational utility 
include the relevance of the information to the decisions you, make 
about the instruction of students, the adequacy of the amount' of 
information, and -the accuracy of the information. 

'b. Indicate any suggestions you might have for improving the report 
^_Cadditi(fn" or deletion of information, format, clarity, etc.). 



C. If you have found additional uses of this report other than the 
ifsagC'^t^a^d by the ^given purpose, please indicate' these uses. 

D*. How often ^dryaiLgj^ke' this report each\week (estimate) ? 
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1.- UNIT 'PERFORMANCE PROFILE 



PURPOSE: To determine Che achievement status bf stud^ents in a unit 



A. User Rating: 



Very » 
Useful 




12 3^/5 
(circle one) 



Not 
Useful 




B. Suggestions for Improvement of Repoi 



C. Uses of This Report Other Than Above Purpose: 



D.- Estimated Frecfuency of Use Per Week: 



r 
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y 


• 


















♦ 
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I>EVELOPING MATHEMATICAL 


PROCESSES 










UNIT PERFORMANCE PROFILE 
UNIT A. R&D DEMONSTRATION 


SCHOOL 














AS OF 


PAGE 1 
0H-20-77 






TOPIC: 

NAME OBJECTIVE: 


1 2 


3 


n 


5 


25 
1 


2 


26 
1 


2 








ADAMS ALAN ' 


M M 


M , 

t 


M 


M 




P 












BAILEY BRIAN ., • 
BERG BECKY 


MP MP 
M M 


MP 
M. 


MP 

M 


MP 
M 


P 
M 


M 
M 


M 
M 


M. 
M 




i 




3RIGGS BRUCE , 
CARLSON ^CARL 


M ■ M ' 
M M 


'm 

M 


M 

M 


M 

M . 


M 


M 


M 
M 


M 








COHEN CATHY 


M M 


M. 


M 


M 


N 


P 


M 


f 

P • 








' DAVIS DAVJ D 
DOYLE DIANE 


M2 M 
M M 


M 

M 


M 

.M 


M ■ 
P 


M 
M 


1 
M 


M 
M 


M 
M 








FARMER FRED 


M M 


i-1 ■ 


M 


M 


M 


M 


M 


M 








FREY FRANK 








- 
















HALL HARRY * 


M2 












• 










HENDERSON- HARVEY 


M2 • 




• 














t 
• 




KBUEGER KEVIN 
























LEk/IS LINDA 


M M 


M . 




M 


M 


M 


M 


M 








MALONEY MARY ' 
MCGUIRF mike' 


M M 

M M- 


M' 


M 
M 


P 
M 


M 
P 




"M 


P 








MOORE HICH-AEL 
•OLSEN OTTCH*w 


M M 
M M 


M, 
M 


M 
M 


M 

P' 


M 

P 


M 

P ■ 


M 


M 








PERRY PAMELA', 


M M 


M 


M 


M 


■ P 


P 


M 


P 




♦ 




PUTNAM PATTY 


M M 


N 




M 


P 


M 


\ M 


M 




• 




ROBERTS RICHARD • " 


M M 




M 


M 


M 


M 


M 


M 




t 




SC HAMFER- SAMUEL 


MP MP 


MP 


MP 


NP 


P 


MP 












SCOTT STEVEN' 


M2 














• 


r 






SMITH SHARON 


M? 




















* 
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V 































2. INDIVIDUAL PERFORMANCE PROFILE- 

PURPOSE: To prpvide achievement information for an individual student. 

i 

A. User Rating: . J^l\ . , 

Useful -t * ; 1- Useful • 

1 2 3 4 5 

(circle- one) 




B. Suggestions for Improvement of Report; 



C. Uses of This Report Other Than Above Purpose: 



D. Estimated Frequency of Use Per Week: 
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DEVELOPING MATHEMATICAL PROCESSES 



INDIVIDUAL PERFORMANCE PROFILE ' ' • PAGE 1 

UNIT A RSeD DEMONSTRATION 3€H00L AS OF 04-20-77 

COftEN CATHY 

TOPIC 24 : THE.^UM3ERS 0-20 ' 

OBJEgrfvE 1 i STATES NUMBER FOR SET 11-20 
< 9- 8-76 M ■. 1- 1-76 N 

'objective 2 : READS NUMBER 11-20 
9- 8-76 M 5-24-76 M - 

J 

OBJECTIVE 3 : WRITES NUMBER 11-20 
9- 8-76 M . 5-24^76 P ' . 

OBJECTIVE 4 : REPRESENTS NU?4BER 11-20 
9- 8-76 M 5-24-76 M 

OBJECTIVE 5 : ORDERS NUMBERS 0-20 
9- 8-76 M 5-24-76 M 

TOPIC 25 : REPRESENTING EQUALIZING SITUATION'S* 

OBJECTIVE 1 : WrItES EQUALIZATION SEJITENCE . ' * ' 

ii-30-76 N ; ' 

OBJECTIVE 2 : CHOOSES EQUALIZATION SENTENCE" 
H-30-76 P . , - . 

TOPIC 26 : MOVEMENT AND DIRECTION . ' , ' . 

OBJECTIVE 1 : CONSTRUCTS PATH GIVEN POINTS 
• 4-14-76 M 



OBJECTIVE \ •: STATES PO^i^TS 
i|-l4-76 P - 



0^1 



TOPIC 27 r-OTHER^-EQUALIZING SITUATIONS ,y 
NOT YET ASSESSED ANY OBJECTIVE 

T TOPIC 28 : SYMMETRY, FRACTIONS AND SHAPE 
NOT YET ASSESSED ON ANY OBJECTIVE 

TOPIC 29;:' JOINING AND SEPARATING SITUATIONS 
NOT YET ASSESSED ON ANY OBJECTIVE 
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3. INSTRUCTIONAL GROUPING RECOMMENDATION-SUMMARY 
PURPOSE: To identify students who need instruction in the skill* requested. 

A. User Rating: /^^ ^ Not 

^ Useful 5 ; ^- Useful 

I ^ I. . ,1 ^ 3 A 5 

(circle one) 



B.^ Suggestions for Improvement of Report: 



C. Uses of This Report Other* Than Above Purpose: 



D. Estimated Frequency of Use Per Week: 
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DEVELOPING MATHEMATICAL PROCESSES 

INSTRUCTIONAL GROUPING RECOMMENDATION - SUMMARY PAGE 1 

UNIT A RiD DEMONSTRATION SCHQOL ' AS OF 04-20-77 

STUDENTS RECOMMENDED FOR ONE OR MORE OF THE FOLLOWING TOPICS : 

TOPIC 25 : REPRESENTING EQUALIZING SITUATIONS 

TOPJC 26 : MOVEMENT AND DIRECTION 

TOPIC 27 : OTHER EQUALIZING SITUATIONS 

TOPIC 28 : SYMMETRY, FRACTIONS, AND SHAPE- 

»»» THE NUMB'ER PRECEDING 'X" INDICATES NUMBER OF. OBJECTIVES. 
IN THE TOPIC NOT YET MASTERED »»» 



.TUDENT NO. - NAME 


. 25 


26 


27 28 




60 


ADAMS ALAN 




2X 




.1 


170 


3R1GGS BRUCE 


2X 


IX 


2X 


3 


205 


CARLSON CARL 






3X*^x 


. 2 


230- 


COHEN CATHY 


2X 




2X 


2 


310 
330 


DAVIS DAVID 
DOYLE DIANE " 






2X 
3X 2X . 


.1 

2 


360 


FARMER FRED • 








1 


430 


HALL HARRY 




2X 




1 


i»76 


HENDERSON HAgVEY 




2X 




1 


630 


KRUEGER KEVJN 




2X 




■ 1 


650 


LEWIS LINDA 






3X 2X 


2 


670 


MALONEY MARY 


IX 




2X 


2 


.690 


MCGUIRE MIKE . 


2X 




2X 


2 


7-10 


MOORE MICHAEL 






2X 


1 


730 


OLSEN OTTO 


% 


2X 




2 


750 


^ERRY PAMELA 






3X 2X 


2 


790 


ROBERTS R1CH.AR4) 






3X 2X 


2 


805 


SCHAMFER SAMUEL 


i. 




2X 


1 


830 


SCOTT STEVEN 




2X 




1 
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4- INSTRUCTIONAL GROUPING RECOMMENDATION-OMISSIONS 



PURPOSE: To identify students who were, not placed in any group for the 
skills requested. . ^ ^ ^ y 



A. User Rating: 



Very 
Useful 



1^2 3 4.5 
(c^.rcle one) 



Not 
Useful 



y 



\ B. . Suggestions for Improvement of Report: 



C. Uses of This Report Other Than Above Purpose: 



D. Estima'ted Frequency, of Use Per Week: 

\ 
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DEVELOPING MATHEMATICAL PROCESSES 



INSTRUCTIONAL- GROUPING RECOMMENDATION - OMISSION PAGE 1 
■UNIT A RiD bEMONSTRATION SCHOOL AS OF OU-20-77 

STUDENTS NOT INCLUDED IN THE GROUPING RECOMMENDATIONS FOR 
THE FOLLOWING TOPICS : 

fOPIC 25 : "PEPRESENTING EQUALIZING? SITUrATIONS 

^ TOPIC 26 : MOVEMENT AND DIRECTION 

TOPIC 27 : OTHER EQUALIZiiNG SITUATIONS 

TOPIC 28 : SYMMETRY, FRACTIONS, AND SHAPE 



NAME 



TOPICS RECOMMENDED 



BAILEY BRIAN 
BERG BECKY 
FREY FRANK 
PUTNAM PATTY. 



29 30 

29 "30 

1 2 16 

24 29 



\ 



254 



ERIC 



r 



' ^ 5. PREREQUISITE DEFICIENCY REPORT 

PURPOSE: To show the prerequisite /achievement status of students 
ineligible for a requested topic. 



A. U-ser plating: J& 

r -Tlstful 1 « 7 1- Useful 

1* 2 3 .4 5 

(circle one) 



B.^ Suggestions for Improvement of Report: 



C. ' Uses of This Report Other Than Aho^ Purpose: 



■ y ■ 

D. Estimated Frequency of Use Per Week: 



255 , 
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DEVELOPING MATHEl^^TICAL PROCESSES 

PREREQUISITE DEFICIENCY REPORT PAGE ^ 1 

UNIT A R4D DEMONSTRATION SCHOOL AS OF 0l»-2O-77 

TOPIC-2^' : OTHER EQUALIZING SITl^ATIONS • - ' . ' 

PREREQUISITE : OR P -RATING ON OBJECTIVES 1 AND 2 OF .TOPIC 

.25. " ' • • 

• ^ r " 

THE FOLLOWING PUPILS ARB- NOT READY FOR TOPIC 27 BECAUSE ACHIEVEMENT 
NOT ASSESSED (NA) OR INSUt^FlCIENT (l). NO fiARK ^INDICATES SUFFICIENT 
ACHIEVEMENT. . . ■ . * • . 

" " TOPIC: 25 ' . " 

•NAME, . OBJECTIVE: 12, 

BRIGGS BRUCE " ' NA NA 

COHEN CATHY • , *I 

t-REY FRANK NA NA . \ 

HAL»U HARRY NA NA ° ^ - 

HENDERSON HARVEY ^ NA NA ^ ' • 

KRUEGER KEVIN - " NA NA' 

MALONEY MARY ^ NA ' •» 

•MCGUIRE MIKE . NA ' _ , 

A 

SCOTT STEVEN * NA HA 

SMITH SHARON' " NA NA . " / 

^ \ " 

TAYLOR TIMOTHY . NA NA 



NUMBER OF ^PUPILS DEFICIENT IN THIS TOPIC = 11 




\ 
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6. SKILL ELIGIBILl^TY PROFILE ' , 



PURPOS?: To show how many 'students have> mastered a particular skill, 
how many are eligible, and how niany are not eligible 
because of prerequisities. 



A.. User Rating: , 
* Useful -1 -z 5 ; j— Useful 

(dircle on^) 



B. Suggestioil^s for Improvement of ^Report: 



C. Us^* df This Report Other Than Above" Purpose : 



V 



D. Estimated Frequency of Use Per Week: 



4^ 



\ 
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< ,^ ■ ■ 

WISCONSIN DESIGN FOR REACTING SKIbl^, DEVELOPMENT 



SKILL ELIGIBILITY PROFILE . 

UNIT A RND DEMONSTRATION ELEMENTARY SCHOOL 



SKILL 



MASTERED 



PAGE 1 
AS OF 04-20-77 



ELIGIBLE NOT ELIGIBLE, 



WA-B-01 




m 


. 8 ' 


3 


WA-B-02 


• 


13 


9 


3 


WA-B-O'3 




13 


8 


n- 










11 


WA-B-OU 




10 




, WA-B-05 




10 


• 1 


1U- 


WA.-B-06 


t' 


7 


1U 




WA-B-07 




6 






WA-B-08 




5 


6 


:iu ' 


. WA-B-09 




- 8 


r 

16 


n ■ 


WA-B-10 




5 




WA-B-1 1 




4 


17 




WA-B-12 




8 


0 


17- 


WA-B-1 3 




6 


2 


. . 17 


SS-B-01 




9 


9 


7 


SS-B-02 




5 


11 


9 


SS-B-03 




9 


9 


" ■ .7 


SS-B-OM 




7 


15 


• . A ^- 



NO. OF STUErENTS IN UNIT x 25 



A 



--2-5-8- 
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7. INSTRyCTIONAL GROUPING RECOMMENDATION--GROUP 



PURPOSE: To recommend students who have met prerequisites for objectives 
but not yet mastered it. 



A. User Rating: 



Very 
Useful 



1 2 3 A 5 
(circle one) 



Not' 
Useful 



B. '^Suggestions for Improvement of Report: 



«4 C. Uses of This Report Other Than Above Purpose; 



D. Estimated Ftequency* of Use Per Week: 



• 259 
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DEVELOPING MATHEMATICAL PROCESSES 



INSTRUCTIONAL GROUPING RECOMMENDATION - GROUP PAGE 1 

UNIT A R4D DEMONSTRATION SCHOOL AS OF 04-20-77 



J 



;''tO^^IC^27 : OTHER EQUALIZING SITUATIONS * 



PREREQUISITE : M OR P RATING, ON OBJECTLVES 1 AND 2 OF TOPIC 
. • 25. ^ 



INDEX* 


NAME^ 


OBJECTIVE^-- 




2 


3 


1 


CARLSON CARL 










2 


DOYLE DIANE 










3 / 


LEWIS LINDA 










i| 


MOORE MICHAEL 




M 


N 


N 


5 » 


1 OLSEN OTTO 










6 


PERRY PAMELA 










7 


.ROBERTS RICHARD 










•8 


SCHAMFER SAMUEL 




N 


P 


M 


NUM3ER 


OF STUDENTS MOT 


ELIGIBLE DUE 


TO 







\ 



ATTEMPTS 
0 
0 

0 
0 
0 

3 

(1) TOPIC ALREADY MASTERED OR IN PROGRESS = 6 

(2) ENROLLMENT IN A GROUP TEACHING THE TOPIC = 0 

(3) FAILURE TO SATISFY PREREQUISITES = 11 



'I 



/ 
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USER IDENTIFICATION OF SCHOOL TASKS ' 

* 

AFFECTED BY CMI 

This questionnaire is designed to identify those school tasks whifch 
are supported by computerized procedures; that is, by CMI. To bfe 
considered compter supported, a task should involve the ;use of com- 
puter printouts in carrying out the task. 

For each t^sk listed below, two responses are required. 

A. First, select from the following four descriptions that one ' 
which ^est describes the involvement of CMI in the task. 

(1) The tas|c involves a CMI procedure which has completely 
. replaced a manual procedure. 

(2) The task involves a CMI procedure which haa^ partially 
replaced a manua^l procedure. ♦ 

(3) The faskt- is new and extra because of CMI, 

(4) Th^ task has not been affected by CMI. 
TO INDICATE YOUR^ CHOICE CIRCLE THE APPROPRIATE NUMBER 

. I. ■ Second, respond YES or NO to the following jfjues t ion about 
each task. 

^ Has your role or responsibilities in thd *^a&k^changed 

because- of ^ CMf? 

T© INDICATE YOUR CHPICE CIRCLE EITHER "YES" OR "NO" 



EXAMPLE 

4 . 



r ^ ' « » -> 

lASK 


/ 

RgSPONSES 


Evalua.ting Individual Student A 
Progress * B 

' ■ 


1 (2)* ■ ^'3 • 4 
,(?es)No 





\ 

'The above illustrative respohses indicate that the respondent consideY^ 
the task referred to involves a CMI procedure which -has-^arti^lly 

1 
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replaced a manual procedure and that her role in the task has been 
changed because of CMI. 



S ■ ■ 

TASK 




1/ Identifying individual A - 
student instructional B 
needs 


12-34 

V ^ « • XT ^ * 

Yes No ^ 


2. Assessing student A 
^ learning outcomes * B 


1 Z J J' . 

Yes No 


v3. Maintaining unit A 
* performance profiles B 


1 2 3 4 
Yes No A 


< - - 

4, Maintaining individual A 
profiles B 


12X34 ' , 
Yes No ) 


5. Comparing the status of A ^ 
students in unit to , B * 
■ . * tschoo-1, sy.stem or other 
norms 


\ ' 

12,34 
Yes No ' 


6. Assessing the attain- A 
ment^ of unit B 
goals 


• 1 \ 2 3 4 

Yes No- 

^ ^' 


7, Assessing the- attain- A 
ment' of individual B 
. student goals 


1 ' 2 3 4 . . 
. . 'Yes No, 

— — ^ — '- 


• ^ • . . . .. 

8. ' Formulating unit A 

goals ■ . ' " B 


. . 1 2 • 3 4 ^ 
' Ye| No 


9. Developing instruc- ^ 'A 
^ . tional objectives for B 
each child in the unit 


12 3 4' . ^ 
Yes No ' 


; 

10. Evaluating learning A 

activities with respect * B \ 
to unit goals 
'l ' tj 


1 ""2 3 4 ^ 
' Yes .No 

• 

' 1 * 
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" / TASK 




RESPONSE 










irv 


Grouping students 
^or instructional 


A 




1 . 

Ye^ 


1 

No 


3 - 


' 4 








ft 

12. 

• 


Counseling \students 
about their Progress 

and fiit"iirp ^<\hriol 


A 
B 




1 
Yes 


2 

No 


3 


4 








13. 


Selecting appropriate 
tn;^fprials media ^ anoN. 
supplies for instruction. 


A 
B 


1 


1 
Yes 


2 

No 


3 


4 


• 


• 




14. 


Evaluating unit / 
operation 


A 
B 


\ 


1 

• Yes 


2 

No 


3 


4 








15. 


Assessing the status of 
entering students 


a'' 

B - 






2 ' 
^No 


3 










15^. 


»« 

Mkintaining school *5 • 
inventory of instruc- 
t ional Tiiat er ials 


A 
B 




1 

Yes 


2 

Np 

^, 


3 


4 








17. 


Reporting school's 
nroeress to central 
administration . 


A 
^B 




1 

Yfes 


— f 

2 

No 


' 3 


' 4 




1 




• 18- 


: — . * 

Reporting student 


A 
B 




1 

Yes 


2 

No 

V 


3 


4' • 




IK- 




19. 


Maintaining permanent 
s c'hool records of 
s.tudents' progress 


A 

B 

i> 


<> 


1 

• Yes 


2 

No 


3 


4 _ ■ 

t 








> 20: 


Developing daily 
teaching^ s chedules 


A 
B 




' i 

Yes 


2 

' No 


X 


4 








, 21. 

f 


Assessing students in 

terjfis of their 

learning characteristics 


A 
B 




i 

Yes 


2 

No 

* 


3 


V 




• . ■ 


V 
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j TASK 

'^^ ' / ^ ' 


RESPONSE 


Sr 

> 22/ Evaluating instruc- A 
tional programs B 
(e.g. , SAPA, Vn)RSD, 
DMP) 


•-1234 
Yes No . 

i r 

* / 


# ^ 

23. •Communicating student A 

information to state B 
agencies 


•» 

12 3 4 
Yes No 


24. 'Updating student A 
performance information B 


12 3. \ 
Yes No ^ ^ 


^ , Marking or scoring A 
tests , B 


1 ' 2 3 4 
'Yes No 


26. Determining rate of A 
• progress of individual B 
' students 


12 3 4 
Yes No 

* 


* ' . ' • ♦ 

^ _ Determining students' A 
readiness for the next B 
, g instructional step 

1 


1 2 3 4. 
Xes -No 


:r 7 

<* 

IT IS IMPORTANT THAT YOU LIST BELOW 
mentioned; ABOVE AND ALSO TO COM? LET 

\ ^ / \ 


— — " V • ' • 

ANY COMPUTER SUPPORTED TASKS NOT 
E THE^ RESPONSES. ' ' ^ 


f 

28. ; " . V . -A 
" . • ^ B 


,1 2 3 4 ^ 
Yes No 

t 


29. A 

* . B 


1^ 2 3 4 ' • 
Yes No 


30. * / . ^ A 

B 


. 1 2 3 ' 4 
Yes. No 


• ■ 264- 
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APPENDIX C 

^ SYSTEM EFFECTS EVALUATION INSTRUMENTS^ 

■ 9 • 



\ 
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Appendix C 



J^!^ \ ReBoanch and LDevelo 



for Cognitive 
Vy/ Learning 

*• * ' 

tho University of Wisconsin^025 West Jphnson St r(?et -/Madison, Wisconsin 53706 (608)262-4901 




t tlenter 



April 8, 197b 



Re: Time Usage Survey ^ ^''^ 



As part of the evaluation of CMI , we are asking user schools to 
participate in a survey designed to determine what affect CMI is having 
on the proportion of time school personnel spend Oii planning, instruc- 
tional and clerical 'tasks*. 

Please find enclosed Time Usage Forms. Directions for completing 
tbe Lorms are on 'their reverse sides. If you feel the need to break 

du so with less than 15 minute bioeks. Act^iched is a used form which 
may be of help in interpreting the directions. 

0 

We arc opting all administrators, teachers, and aides ' *. ^ 
who, are using the computer services of CMI to complete' a time usage 
Jform\ Please select any half of these staff to complete tjje form for 
any one week and the other half of the staff for the following week. 
The particular wc^ks chosen should be "normal" school times; that is, 
times which will produce information representative of general school 
activittps and give a fair indic.iLion of the times spent by staff pn ' 
planning tasks, inst ruc<rional tasks and clerical tasks. 'In cases 
where teachers are absent, please ask the substitute teacher to complete 
tlie fprm as far as is possible for that day(s). 

The sclucLion of the weeks in which the suruey is to be conducted 
and the' selection of the staff to be* surveyed during each of the two 
different weeks is at the discretion oi the principal. However, the 
forms, should he returned to me at tlm Research, and Developirent Center 
during the first week 'of .May. • If you have any questions about the ^ 
Time Us<ip>^ Survey, please contact me at (608) 263-3099. 



^Thank you f(5r your Cooperation, 



You^sTsincerely , 

Brian Lawrence 

KvaluaLor, W1S-S4M Project 

26G 
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/ QUESTIONNAIRIi TO BE. 

COl^LETED BY THE PRINCIPAL 

As^ an d*^ to iuLorpreting the data collected as part of the present 
Time Usage Survey and as an aid in its comparison with data collected 
in earlier surveys, pleaae provide the following information. ' 



1975 



1976 



1. Number of students 



2. Number of teachers (F.T.E.) 

3. Number of aide$ "^^l- 



A. Number of aides using computers 
5. Number of school administrators 



B. For the .period of- the present Time Usage Survey, are there any 
school related activities which may have unusually pronounced ^ 

/ ■ ■ - i' 

affects on the times allocated to clerical, planning and instruc- 
tional activities by teaches, administrators ""or aides and which 
may give 'misleading estimates of the various times? 

(a) TEACHERS: (including unit leaders) Yes N6 . 

Description of Unusual Activities: 



4 
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(b) .ADMINISTRATORS: 



Yes 



No 



Description of Unusual Activities^ 
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(c) AIDES: Yes No 



• Dcs\|.ription of Unusual Activities: 



C. Only to be completed for schools which participated in the 1975 
QII Time Usage Survey. ^ 



-J 

Percentage Changes ^n Times Spent in 



7' 



^ Different Tasks By Different Personnel 

Since the Last Time Usage Survey ^ ^ . ^ 

Please indicate whether there have been any attempt-s to increase or 
decrease the percentages of time spent on planning, instructional, and 
clerical tasks by administrators , teachers, and aides since the last 
Time Usage' Survey in 1975. (For example, thefee changes may have been 
attempted by hiring additional clerical help or reallocation of duties.) 
Complete the table on the' following page indicating your estimate 



of^an increase as + and decreases as 
♦ 



t 
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% Change in 

% Change in Instructional % Change in 

Planning Time Time Clerical Time 
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TIME USAGE FORM 



The* CMI Project now 'being used^by your school has several goals. 
One of the^^imary aims is to aid staff members by reducing the amount 
/ of time sp^nt doing-^^Qlerical work. We hope reach this goal b> having 
the computer do some of tfte clerical work and provide you with informa- 
tion that Will facilitate the decisions made in planning^. In order to 
eyaluat^ the progress towards these ends we need to tollect data on hOw(^ 
your time is spent at several stages of the project. This form will 
provide us with information regarding your current time usage and will 
be used for comparison with your time usage later on. 



Please fill out this chart on a daily^^asis, writing in P, I, or^ 
C in each hour block during the day and adding an estimate of any hours 
after the work day spent on any of these activities. Please indicate 
your position by circling the approp*riate title or writing in your 
position if you have any questipn as to which category you fall into. 



The more accurate and candid your information is, the better CMI 
^ . f 

will be able to evaluate Tiow well we are assisting you and where we can 
improve our efforts. Thank you for- your cooperation. 
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TIME USAGE FORM 



P - Planning' Hours: attending staff meetings , ^organizing instruction and materials, etc.- 

I.- Instructing Hours: teaching, other activities directly interfacing students. ^ - 

' . » * . 

C - Clerical Hours: filling out 'forms, writing reports, grading, etc. , 

Week: • - Position : Teacher, Unit Leader, Administrator, Secretary, 

^ Aide*, etc - f ^ 

HOURS OF THE DAY , 1 ? ' 



DAY. 



7. 8 



10 



11 



12 



4^ 



dther 





















If* 










Sunday . ♦ 

(If applicable) 












J 






t 

* 


w 




- 


/ 0 
/ 


Monday 










I 


r 














— : 


> 

Tuesday • / 


























■ ^ , 


Wednesday 


I 
















J- 










Thursday 






/ 




















* 


Friday 




/ 


















J 




f 


Saturday 

(If applicafele) 




* 
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. SCHOOL 



DATE' . ^ 



^GES IN SCHOOL OPERATIONS • 

•A ' . 

To be completed by* administrators and unit leaders. 



Indicate below any" Tihanges in the activities af the school which you 
consider have; been the res.ult of implementing the Wl'S-SIM CMI system. 
Please 'provide -a sentence description of each activ/ty. <^hanges Include i 
new activities introduced as a result, of CMI, activities deleted as a 
result of CMI, and activities modified as a resuXc of* CMI. Please list- 
such activities unhev the headings of: ' 0 

In-Services (Indicate length and , frequency) 



Meetings (Indicate length and 'frequency) 



Consultations With Curriculum -Specialists (Indicate f requen^y)^^ 



Changes* in the SchooT Schedule 

Changes in Commufiication Proeedureg 

J 

1 

Other^fiChanges in School Operations ^ 
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QUESTIONNAIRE TO BE 

COMPLETED BY THE 'PRINCIPAL 

»■ ^ <i 

As an aid to interpreting ^he dat^ collected aa part of the -present 
le Usage Surve^ and as an aid in its comparison wit;h data collected 
••arlier surveys, please provide tfie following information. 



1975 



1976 



1. 


Number 


of 


students 

< 


2. 


Number 


of 


teachers (F.T*E.) \* 










3. 


Numbe'r 


of 


aides 

Y 


4. 


Number 


of 


aides using computers 


•5. 


Number- 


of 


school administrators 



Eor^ the period of the p^resent Time Usage Survey, are tlxere .any 
school related activities which may have unusually pronouncfSH*^ 
affects on the times allocated to clerical, planning and instruc-^ 
tional activities by teachers, administrator^ or aides and which 
may give misleading e,stimates of the various times? * <f 



(a) tEACHERS: (including anit leaders) Yes 
Description ef Uni^ual Activities; 



No 



(b) ADMINISTRAIDi^t Yes . No 

Description of Unusual Activities: 



"7^ 
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' (c) AIDES: ' Yes ■ ' ' No 



Description of Unusual Activities: 



C. Only to be completed^f pr^'schools which participated in the 1975. 
CMI Time Usage Survey. 

■ "^-^ 

Percentage Changes in Times Spent in 

* «■ ♦ • 

Different Tasks. By Different Personnel 
Since the Last Time Usage Survey 
Please indicate' whether there have iJeen any attempts to* increase pr 
"decrease the percentages of t*ime spent on planning, instructional, and 
clerical tasks by administrators, «^achers, and aides since thJfe last 
Time Usage 'Sqrvey in 1975. (For . example , these changes may have been ' 
(attempted by hiring additional clerical help or reallocation of duties.) 



' ^ Com{)l^te th,e table on ^he following page indicating' your estimate ^ ' 
of an increase as + and decreases as--. / 



■ ■ / 



f 



\ 

\ 



0* 



Administrators 



r 



Teachers 



Aides 



I- 



% Change in 
Planning Time 



% Cha;Jige in 
Instructional^ 
'lime 



ir 
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% Change in 
Clerical Time 



r 
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Center Planning and Policy Committee 



Richard- A, Rossmiller 

Wayne Otto 

Center Co-directors 



yiayna Otto-' 

Area Chairperson 

Studies in Reading, Language 

and Communication 

Marvin J. Fruth 

Area Chairperson^ ' * 
.Stuc^ies of Implemenfaticrn of 
. Individualized Schooling 



Herbert J. Klausmeier 
Area Chairperson ^ 
> Studies of Instructional Programming 
for the. Individual Student 

^M. Lipham 

Chairperson . ' 

ies'of Administration and ^ 
ization for Instruction 

lomas A. Romberg 
Area Chairperson , 
Studies in Mathemati.es and Evaluation 
of Practices in Individualized Schooling 




Associated Faculty 



0 



Vernon L. Allien 

Processor 

Psychology 



B. Dean BQwles^ — ^ 
Professor / 

Educational Administration 

Thomas P. Carpenter^ 
Associate Professor 
Curriculum and » Instruct ion 

W. Patrick Dickson 
\ Assistant Professor 
Child, and Familj^ Studies 

* Marvin J'. Fruth 
"Professor 

Educational Administration 

* John G. Harvey 
, Professor 

Mathematics ^ ^ ^ 
Curriculum and ins truc|tj.Qn ^ 

* Fran/C" H . Hooper ^ 
Professor 

Child and Family .Stucjies 



Dale Johnson 
Professor 
Curriculum and 'instroct^'ion 



Herbert J. Klausmeier 
V.-A.C. Henmon Professor - 
, Educational Psychology 

Jos-eph-^T. LaWton ' 
Assistant Professor 
Clfild and Family 'Studies 

Joel R. LevLn 
Professor ' 

Educational Psychology 

'James M. Lipham 
Professor 

Educational Administration 

Dominic W. Massaro 
Professor* ^ a • . 

Psychology * 

Donald M. Mclsaac ^ 
Processor 

Eduqat^ion*! Administratibn 

Wayne R. Otto 
Professor ^ 

Curriculum and Instruction 

\ , * 

Penelope L. Peterson 

Assistant Professor 

Educa.tiona.1 Psychology 
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Robert G, -Petzold 
Prof essor ' 
Music 

Curriculum and Instruction 

Thomas S. Popkewitz 
Associate Professor 
Curriculum and Instruction 

Gary G. Price 
Assistant Professor 
Curriculum and Instruction 

* 

"Thomas A. Romberg 
Professor 

Curriculum and Instruction 



/Richard A. Rossmiller 
/ Professor 

' Educational Administration 



B . Rober t ' '^abachnick 

Prcff es^or » ' 

Curr^cyJLum and Instruction 

J. Fred' Weaver • 

P^70f e^s9j , , ^ 

'Curriculum and Instructic^ 

Gary G. 'Wehlage . , /' 
^ Associate Professor ^ ' 
Curriculum and Instruction 
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